Nov 08 15:07:24 user nova-compute[74788]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74788) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 15:07:24 user nova-compute[74788]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74788) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 15:07:24 user nova-compute[74788]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74788) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 15:07:24 user nova-compute[74788]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 15:07:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:07:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:07:25 user nova-compute[74788]: INFO nova.virt.driver [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 15:07:25 user nova-compute[74788]: INFO nova.compute.provider_config [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Acquiring lock "singleton_lock" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Acquired lock "singleton_lock" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Releasing lock "singleton_lock" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Full set of CONF: {{(pid=74788) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ******************************************************************************** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Configuration options gathered from: {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ================================================================================ {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] allow_resize_to_same_host      = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] arq_binding_timeout            = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] backdoor_port                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] backdoor_socket                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] block_device_allocate_retries  = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] block_device_allocate_retries_interval = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cert                           = self.pem {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute_monitors               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] config_dir                     = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] config_drive_format            = iso9660 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] config_source                  = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] console_host                   = user {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] control_exchange               = nova {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cpu_allocation_ratio           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] daemon                         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] debug                          = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_access_ip_network_name = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_availability_zone      = nova {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_ephemeral_format       = ext4 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_green_pool_size        = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] default_schedule_zone          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] disk_allocation_ratio          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] enable_new_services            = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] enabled_ssl_apis               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] flat_injected                  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] force_config_drive             = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] force_raw_images               = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] graceful_shutdown_timeout      = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] heal_instance_info_cache_interval = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] host                           = user {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_build_timeout         = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_delete_interval       = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_name_template         = instance-%08x {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_usage_audit           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_usage_audit_period    = month {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] internal_service_availability_zone = internal {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] key                            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] live_migration_retry_count     = 30 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_config_append              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_dir                        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_file                       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_options                    = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_rotate_interval            = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_rotate_interval_type       = days {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] log_rotation_type              = none {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] long_rpc_timeout               = 1800 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_concurrent_builds          = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_concurrent_live_migrations = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_concurrent_snapshots       = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_local_block_devices        = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_logfile_count              = 30 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] max_logfile_size_mb            = 200 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] maximum_instance_delete_attempts = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metadata_listen                = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metadata_listen_port           = 8775 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metadata_workers               = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] migrate_max_retries            = -1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] mkisofs_cmd                    = genisoimage {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] my_ip                          = 10.0.0.210 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] network_allocate_retries       = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] osapi_compute_listen_port      = 8774 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] osapi_compute_unique_server_name_scope =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] osapi_compute_workers          = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] password_length                = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] periodic_enable                = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] periodic_fuzzy_delay           = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] pointer_model                  = ps2mouse {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] preallocate_images             = none {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] publish_errors                 = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] pybasedir                      = /opt/stack/nova {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ram_allocation_ratio           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rate_limit_burst               = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rate_limit_except_level        = CRITICAL {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rate_limit_interval            = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reboot_timeout                 = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reclaim_instance_interval      = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] record                         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reimage_timeout_per_gb         = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] report_interval                = 120 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rescue_timeout                 = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reserved_host_cpus             = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reserved_host_disk_mb          = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reserved_host_memory_mb        = 512 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] reserved_huge_pages            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] resize_confirm_window          = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] resize_fs_using_block_device   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] resume_guests_state_on_host_boot = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rpc_response_timeout           = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] run_external_periodic_tasks    = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] running_deleted_instance_action = reap {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] running_deleted_instance_timeout = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler_instance_sync_interval = 120 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_down_time              = 720 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] servicegroup_driver            = db {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] shelved_offload_time           = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] shelved_poll_interval          = 3600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] shutdown_timeout               = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] source_is_ipv6                 = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ssl_only                       = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] state_path                     = /opt/stack/data/nova {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] sync_power_state_interval      = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] sync_power_state_pool_size     = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] syslog_log_facility            = LOG_USER {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] tempdir                        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] timeout_nbd                    = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] transport_url                  = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] update_resources_interval      = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_cow_images                 = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_eventlog                   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_journal                    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_json                       = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_rootwrap_daemon            = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_stderr                     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] use_syslog                     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vcpu_pin_set                   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plugging_is_fatal          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plugging_timeout           = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] virt_mkfs                      = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] volume_usage_poll_interval     = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] watch_log_file                 = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] web                            = /usr/share/spice-html5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_concurrency.disable_process_locking = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.auth_strategy              = keystone {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.compute_link_prefix        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.dhcp_domain                = novalocal {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.enable_instance_password   = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.glance_link_prefix         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.instance_list_per_project_cells = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.list_records_by_skipping_down_cells = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.local_metadata_per_cell    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.max_limit                  = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.metadata_cache_expiration  = 15 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.neutron_default_tenant_id  = default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.use_forwarded_for          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.use_neutron_default_nets   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_dynamic_targets = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_jsonfile_path   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.backend_argument         = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.config_prefix            = cache.oslo {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.dead_timeout             = 60.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.debug_cache_backend      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.enable_retry_client      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.enable_socket_keepalive  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.enabled                  = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.expiration_time          = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.hashclient_retry_attempts = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_dead_retry      = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_password        =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_sasl_enabled    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.memcache_username        =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.proxies                  = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.retry_attempts           = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.retry_delay              = 0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.socket_keepalive_count   = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.socket_keepalive_idle    = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.socket_keepalive_interval = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.tls_allowed_ciphers      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.tls_cafile               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.tls_certfile             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.tls_enabled              = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cache.tls_keyfile              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.auth_section            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.auth_type               = password {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.cafile                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.certfile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.collect_timing          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.cross_az_attach         = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.debug                   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.endpoint_template       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.http_retries            = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.insecure                = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.keyfile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.os_region_name          = RegionOne {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.split_loggers           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cinder.timeout                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.cpu_dedicated_set      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.cpu_shared_set         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.image_type_exclude_list = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.resource_provider_association_refresh = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.shutdown_retry_interval = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] conductor.workers              = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] console.allowed_origins        = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] console.ssl_ciphers            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] console.ssl_minimum_version    = default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] consoleauth.token_ttl          = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.cafile                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.certfile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.collect_timing          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.connect_retries         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.connect_retry_delay     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.endpoint_override       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.insecure                = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.keyfile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.max_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.min_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.region_name             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.service_name            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.service_type            = accelerator {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.split_loggers           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.status_code_retries     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.timeout                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] cyborg.version                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.backend               = sqlalchemy {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.connection            = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.connection_debug      = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.connection_parameters =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.connection_recycle_time = 3600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.connection_trace      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.db_inc_retry_interval = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.db_max_retries        = 20 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.db_max_retry_interval = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.db_retry_interval     = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.max_overflow          = 50 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.max_pool_size         = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.max_retries           = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.mysql_wsrep_sync_wait = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.pool_timeout          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.retry_interval        = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.slave_connection      = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] database.sqlite_synchronous    = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.backend           = sqlalchemy {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.connection        = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.connection_debug  = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.connection_parameters =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.connection_recycle_time = 3600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.connection_trace  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.db_inc_retry_interval = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.db_max_retries    = 20 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.db_max_retry_interval = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.db_retry_interval = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.max_overflow      = 50 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.max_pool_size     = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.max_retries       = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.pool_timeout      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.retry_interval    = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.slave_connection  = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] api_database.sqlite_synchronous = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] devices.enabled_mdev_types     = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ephemeral_storage_encryption.enabled = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.api_servers             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.cafile                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.certfile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.collect_timing          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.connect_retries         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.connect_retry_delay     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.debug                   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.default_trusted_certificate_ids = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.enable_certificate_validation = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.enable_rbd_download     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.endpoint_override       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.insecure                = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.keyfile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.max_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.min_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.num_retries             = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.rbd_ceph_conf           =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.rbd_connect_timeout     = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.rbd_pool                =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.rbd_user                =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.region_name             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.service_name            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.service_type            = image {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.split_loggers           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.status_code_retries     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.timeout                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.verify_glance_signatures = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] glance.version                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] guestfs.debug                  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.config_drive_cdrom      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.config_drive_inject_password = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.enable_remotefx         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.instances_path_share    =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.limit_cpu_features      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.use_multipath_io        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.vswitch_name            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] mks.enabled                    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.manager_interval   = 2400 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.precache_concurrency = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.remove_unused_base_images = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] image_cache.subdirectory_name  = _base {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.api_max_retries         = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.api_retry_interval      = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.auth_section            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.auth_type               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.cafile                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.certfile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.collect_timing          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.conductor_group         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.connect_retries         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.connect_retry_delay     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.endpoint_override       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.insecure                = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.keyfile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.max_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.min_version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.peer_list               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.region_name             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.serial_console_state_timeout = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.service_name            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.service_type            = baremetal {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.split_loggers           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.status_code_retries     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.timeout                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ironic.version                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] key_manager.fixed_key          = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.barbican_api_version  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.barbican_endpoint     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.barbican_endpoint_type = public {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.barbican_region_name  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.cafile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.certfile              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.collect_timing        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.insecure              = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.keyfile               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.number_of_retries     = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.retry_delay           = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.send_service_user_token = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.split_loggers         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.timeout               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.verify_ssl            = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican.verify_ssl_path       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.auth_section = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.auth_type = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.cafile   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.certfile = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.collect_timing = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.insecure = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.keyfile  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.split_loggers = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] barbican_service_user.timeout  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.approle_role_id          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.approle_secret_id        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.cafile                   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.certfile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.collect_timing           = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.insecure                 = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.keyfile                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.kv_mountpoint            = secret {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.kv_path                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.kv_version               = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.namespace                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.root_token_id            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.split_loggers            = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.ssl_ca_crt_file          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.timeout                  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.use_ssl                  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.auth_section          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.auth_type             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.cafile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.certfile              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.collect_timing        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.connect_retries       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.connect_retry_delay   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.endpoint_override     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.insecure              = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.keyfile               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.max_version           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.min_version           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.region_name           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.service_name          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.service_type          = identity {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.split_loggers         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.status_code_retries   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.timeout               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] keystone.version               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.connection_uri         =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_mode               = custom {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: WARNING oslo_config.cfg [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_power_governor_high = performance {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_power_management   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.device_detach_attempts = 8 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.device_detach_timeout  = 20 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.disk_cachemodes        = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.disk_prefix            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.enabled_perf_events    = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.file_backed_memory     = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.gid_maps               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.hw_disk_discard        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.hw_machine_type        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_rbd_pool        = rbd {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_type            = default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.images_volume_group    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.inject_key             = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.inject_partition       = -2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.inject_password        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.iscsi_iface            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.iser_use_multipath     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_downtime = 500 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_inbound_addr = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_scheme  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_timeout_action = abort {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_tunnelled = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: WARNING oslo_config.cfg [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 15:07:25 user nova-compute[74788]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 15:07:25 user nova-compute[74788]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 15:07:25 user nova-compute[74788]: and ``live_migration_inbound_addr`` respectively.
Nov 08 15:07:25 user nova-compute[74788]: ).  Its value may be silently ignored in the future.
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.live_migration_with_native_tls = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.max_queues             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.nfs_mount_options      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_pcie_ports         = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.pmem_namespaces        = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.quobyte_client_cfg     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rbd_secret_uuid        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rbd_user               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rescue_image_id        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rescue_kernel_id       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.rx_queue_size          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.smbfs_mount_options    =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.snapshot_compression   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.snapshot_image_format  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.sparse_logical_volumes = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.swtpm_enabled          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.swtpm_group            = tss {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.swtpm_user             = tss {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.sysinfo_serial         = unique {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.tb_cache_size          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.tx_queue_size          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.uid_maps               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.use_virtio_for_bridges = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.virt_type              = kvm {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.volume_clear           = zero {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.volume_clear_size      = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.volume_use_multipath   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_cache_path   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.auth_section           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.auth_type              = password {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.cafile                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.certfile               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.collect_timing         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.connect_retries        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.connect_retry_delay    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.default_floating_pool  = public {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.endpoint_override      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.extension_sync_interval = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.http_retries           = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.insecure               = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.keyfile                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.max_version            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.min_version            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.ovs_bridge             = br-int {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.physnets               = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.region_name            = RegionOne {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.service_metadata_proxy = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.service_name           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.service_type           = network {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.split_loggers          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.status_code_retries    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.timeout                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] neutron.version                = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] notifications.bdms_in_notifications = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] notifications.default_level    = INFO {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] notifications.notification_format = unversioned {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] notifications.notify_on_state_change = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] pci.alias                      = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] pci.device_spec                = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] pci.report_in_placement        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.auth_section         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.auth_type            = password {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.cafile               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.certfile             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.collect_timing       = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.connect_retries      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.connect_retry_delay  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.default_domain_id    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.default_domain_name  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.domain_id            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.domain_name          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.endpoint_override    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.insecure             = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.keyfile              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.max_version          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.min_version          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.password             = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.project_domain_id    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.project_domain_name  = Default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.project_id           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.project_name         = service {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.region_name          = RegionOne {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.service_name         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.service_type         = placement {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.split_loggers        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.status_code_retries  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.system_scope         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.timeout              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.trust_id             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.user_domain_id       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.user_domain_name     = Default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.user_id              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.username             = placement {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] placement.version              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.cores                    = 20 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.count_usage_from_placement = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.injected_file_content_bytes = 10240 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.injected_file_path_length = 255 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.injected_files           = 5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.instances                = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.key_pairs                = 100 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.metadata_items           = 128 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.ram                      = 51200 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.recheck_quota            = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.server_group_members     = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] quota.server_groups            = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rdp.enabled                    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.image_metadata_prefilter = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.max_attempts         = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.max_placement_results = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] scheduler.workers              = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.host_subset_size = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.isolated_hosts = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.isolated_images = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.pci_in_placement = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.track_instance_changes = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metrics.required               = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metrics.weight_multiplier      = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] metrics.weight_setting         = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.enabled         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.port_range      = 10000:20000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] serial_console.serialproxy_port = 6083 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.auth_section      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.auth_type         = password {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.cafile            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.certfile          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.collect_timing    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.insecure          = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.keyfile           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.send_service_user_token = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.split_loggers     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] service_user.timeout           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.agent_enabled            = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.enabled                  = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.html5proxy_port          = 6082 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.image_compression        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.jpeg_compression         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.playback_compression     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.server_listen            = 127.0.0.1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.streaming_mode           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] spice.zlib_compression         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] upgrade_levels.baseapi         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] upgrade_levels.cert            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] upgrade_levels.compute         = auto {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] upgrade_levels.conductor       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] upgrade_levels.scheduler       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.cafile = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.certfile = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.insecure = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vendordata_dynamic_auth.timeout = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.api_retry_count         = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.ca_file                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.cache_prefix            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.cluster_name            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.connection_pool_size    = 10 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.console_delay_seconds   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.datastore_regex         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.host_ip                 = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.host_password           = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.host_port               = 443 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.host_username           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.insecure                = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.integration_bridge      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.maximum_objects         = 100 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.pbm_default_policy      = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.pbm_enabled             = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.pbm_wsdl_location       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.serial_port_proxy_uri   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.serial_port_service_uri = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.task_poll_interval      = 0.5 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.use_linked_clone        = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.vnc_keymap              = en-us {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.vnc_port                = 5900 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vmware.vnc_port_total          = 10000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.auth_schemes               = ['none'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.enabled                    = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.novncproxy_port            = 6080 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.vencrypt_ca_certs          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.vencrypt_client_cert       = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vnc.vencrypt_client_key        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.disable_rootwrap   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.enable_numa_live_migration = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.libvirt_disable_apic = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.client_socket_timeout     = 900 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.default_pool_size         = 1000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.keep_alive                = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.max_header_line           = 16384 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.ssl_ca_file               = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.ssl_cert_file             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.ssl_key_file              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.tcp_keepidle              = 600 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] zvm.ca_file                    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] zvm.cloud_connector_url        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] zvm.reachable_timeout          = 300 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.enforce_new_defaults = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.enforce_scope      = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.policy_default_rule = default {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.connection_string     = messaging:// {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.enabled               = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.es_doc_type           = notification {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.es_scroll_size        = 10000 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.es_scroll_time        = 2m {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.filter_error_trace    = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.hmac_keys             = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.sentinel_service_name = mymaster {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.socket_timeout        = 0.1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.trace_requests        = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler.trace_sqlalchemy      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler_jaeger.process_tags   = {} {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler_jaeger.service_name_prefix = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] profiler_otlp.service_name_prefix = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] remote_debug.host              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] remote_debug.port              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_notifications.retry = -1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.auth_section        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.auth_type           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.cafile              = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.certfile            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.collect_timing      = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.connect_retries     = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.connect_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.endpoint_id         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.endpoint_override   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.insecure            = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.keyfile             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.max_version         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.min_version         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.region_name         = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.service_name        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.service_type        = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.split_loggers       = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.status_code_retries = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.status_code_retry_delay = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.timeout             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.valid_interfaces    = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_limit.version             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_reports.file_event_handler = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] oslo_reports.log_dir           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.group  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] vif_plug_ovs_privileged.user   = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.isolate_vif         = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] os_brick.lock_path             = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.capabilities   = [21] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.group          = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.helper_command = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] privsep_osbrick.user           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.group           = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.helper_command  = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] nova_sys_admin.user            = None {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG oslo_service.service [None req-1efe1e53-8f23-4a9b-b360-799102dc163e None None] ******************************************************************************** {{(pid=74788) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 15:07:25 user nova-compute[74788]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Connecting to libvirt: qemu:///system {{(pid=74788) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7794167040> {{(pid=74788) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 15:07:25 user nova-compute[74788]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 15:07:25 user nova-compute[74788]: WARNING nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7794167040> {{(pid=74788) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Starting native event thread {{(pid=74788) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Starting green dispatch thread {{(pid=74788) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Starting connection event dispatch thread {{(pid=74788) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 15:07:25 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Connection event '1' reason 'None'
Nov 08 15:07:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 15:07:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.mount [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Initialising _HostMountState generation 0 {{(pid=74788) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 15:07:32 user nova-compute[74788]: INFO nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host capabilities <capabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <host>
Nov 08 15:07:32 user nova-compute[74788]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 15:07:32 user nova-compute[74788]:     <cpu>
Nov 08 15:07:32 user nova-compute[74788]:       <arch>x86_64</arch>
Nov 08 15:07:32 user nova-compute[74788]:       <model>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <microcode version='1070'/>
Nov 08 15:07:32 user nova-compute[74788]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='osxsave'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='invtsc'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='rsba'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 15:07:32 user nova-compute[74788]:       <pages unit='KiB' size='4'/>
Nov 08 15:07:32 user nova-compute[74788]:       <pages unit='KiB' size='2048'/>
Nov 08 15:07:32 user nova-compute[74788]:     </cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <power_management>
Nov 08 15:07:32 user nova-compute[74788]:       <suspend_mem/>
Nov 08 15:07:32 user nova-compute[74788]:       <suspend_disk/>
Nov 08 15:07:32 user nova-compute[74788]:       <suspend_hybrid/>
Nov 08 15:07:32 user nova-compute[74788]:     </power_management>
Nov 08 15:07:32 user nova-compute[74788]:     <iommu support='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <migration_features>
Nov 08 15:07:32 user nova-compute[74788]:       <live/>
Nov 08 15:07:32 user nova-compute[74788]:       <uri_transports>
Nov 08 15:07:32 user nova-compute[74788]:         <uri_transport>tcp</uri_transport>
Nov 08 15:07:32 user nova-compute[74788]:         <uri_transport>rdma</uri_transport>
Nov 08 15:07:32 user nova-compute[74788]:       </uri_transports>
Nov 08 15:07:32 user nova-compute[74788]:     </migration_features>
Nov 08 15:07:32 user nova-compute[74788]:     <topology>
Nov 08 15:07:32 user nova-compute[74788]:       <cells num='2'>
Nov 08 15:07:32 user nova-compute[74788]:         <cell id='0'>
Nov 08 15:07:32 user nova-compute[74788]:           <memory unit='KiB'>8140616</memory>
Nov 08 15:07:32 user nova-compute[74788]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 08 15:07:32 user nova-compute[74788]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 15:07:32 user nova-compute[74788]:           <distances>
Nov 08 15:07:32 user nova-compute[74788]:             <sibling id='0' value='10'/>
Nov 08 15:07:32 user nova-compute[74788]:             <sibling id='1' value='20'/>
Nov 08 15:07:32 user nova-compute[74788]:           </distances>
Nov 08 15:07:32 user nova-compute[74788]:           <cpus num='6'>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 15:07:32 user nova-compute[74788]:           </cpus>
Nov 08 15:07:32 user nova-compute[74788]:         </cell>
Nov 08 15:07:32 user nova-compute[74788]:         <cell id='1'>
Nov 08 15:07:32 user nova-compute[74788]:           <memory unit='KiB'>8255068</memory>
Nov 08 15:07:32 user nova-compute[74788]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 08 15:07:32 user nova-compute[74788]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 15:07:32 user nova-compute[74788]:           <distances>
Nov 08 15:07:32 user nova-compute[74788]:             <sibling id='0' value='20'/>
Nov 08 15:07:32 user nova-compute[74788]:             <sibling id='1' value='10'/>
Nov 08 15:07:32 user nova-compute[74788]:           </distances>
Nov 08 15:07:32 user nova-compute[74788]:           <cpus num='6'>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 15:07:32 user nova-compute[74788]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 15:07:32 user nova-compute[74788]:           </cpus>
Nov 08 15:07:32 user nova-compute[74788]:         </cell>
Nov 08 15:07:32 user nova-compute[74788]:       </cells>
Nov 08 15:07:32 user nova-compute[74788]:     </topology>
Nov 08 15:07:32 user nova-compute[74788]:     <cache>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 15:07:32 user nova-compute[74788]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 15:07:32 user nova-compute[74788]:     </cache>
Nov 08 15:07:32 user nova-compute[74788]:     <secmodel>
Nov 08 15:07:32 user nova-compute[74788]:       <model>apparmor</model>
Nov 08 15:07:32 user nova-compute[74788]:       <doi>0</doi>
Nov 08 15:07:32 user nova-compute[74788]:     </secmodel>
Nov 08 15:07:32 user nova-compute[74788]:     <secmodel>
Nov 08 15:07:32 user nova-compute[74788]:       <model>dac</model>
Nov 08 15:07:32 user nova-compute[74788]:       <doi>0</doi>
Nov 08 15:07:32 user nova-compute[74788]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 15:07:32 user nova-compute[74788]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 15:07:32 user nova-compute[74788]:     </secmodel>
Nov 08 15:07:32 user nova-compute[74788]:   </host>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='alpha'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>clipper</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='armv6l'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>spitz</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>nuri</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>kzm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>z2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>tosa</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n810</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>terrier</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>midway</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>microbit</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>verdex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>highbank</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>akita</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>connex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>collie</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='armv7l'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>spitz</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>nuri</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>kzm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>z2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>tosa</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n810</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>terrier</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>midway</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>microbit</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>verdex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>highbank</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>akita</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>connex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>collie</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='aarch64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>spitz</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>nuri</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>kzm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>z2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>tosa</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n810</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>n800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>terrier</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>midway</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>microbit</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>verdex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>highbank</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>akita</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>connex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>collie</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <acpi default='on' toggle='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='cris'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='i686'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>isapc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>microvm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='kvm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <pae/>
Nov 08 15:07:32 user nova-compute[74788]:       <nonpae/>
Nov 08 15:07:32 user nova-compute[74788]:       <acpi default='on' toggle='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:       <apic default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='m68k'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>an5206</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>q800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='microblaze'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='microblazeel'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='mips'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>malta</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='mipsel'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>malta</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='mips64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>malta</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>pica61</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>magnum</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='mips64el'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>malta</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>pica61</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>magnum</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='16'>boston</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='ppc'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mac99</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>40p</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>taihu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='ppc64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>taihu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>40p</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mac99</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='ppc64le'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>taihu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>40p</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>mac99</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='riscv32'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='8'>spike</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='8'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='riscv64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='8'>spike</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='8'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='s390x'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='sh4'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>shix</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>r2d</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='sh4eb'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>shix</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>r2d</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='sparc'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>LX</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='sparc64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>niagara</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='x86_64'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>64</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='1'>isapc</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>microvm</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='kvm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <acpi default='on' toggle='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:       <apic default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='xtensa'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>sim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>kc705</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ml605</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx200</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx60</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]:   <guest>
Nov 08 15:07:32 user nova-compute[74788]:     <os_type>hvm</os_type>
Nov 08 15:07:32 user nova-compute[74788]:     <arch name='xtensaeb'>
Nov 08 15:07:32 user nova-compute[74788]:       <wordsize>32</wordsize>
Nov 08 15:07:32 user nova-compute[74788]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='4'>sim</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>kc705</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ml605</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>virt</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx200</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>lx60</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 15:07:32 user nova-compute[74788]:       <domain type='qemu'/>
Nov 08 15:07:32 user nova-compute[74788]:     </arch>
Nov 08 15:07:32 user nova-compute[74788]:     <features>
Nov 08 15:07:32 user nova-compute[74788]:       <cpuselection/>
Nov 08 15:07:32 user nova-compute[74788]:       <deviceboot/>
Nov 08 15:07:32 user nova-compute[74788]:       <disksnapshot default='on' toggle='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     </features>
Nov 08 15:07:32 user nova-compute[74788]:   </guest>
Nov 08 15:07:32 user nova-compute[74788]: </capabilities>
Nov 08 15:07:32 user nova-compute[74788]: 
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-q35-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>i686</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='288'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'/>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='lm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-q35-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>i686</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='288'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'/>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='lm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-i440fx-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>i686</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='255'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'/>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='lm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ide</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-i440fx-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>i686</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='255'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'/>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='lm'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ide</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-q35-6.2</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>x86_64</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='288'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>efi</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='invtsc'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='rsba'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-q35-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>x86_64</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='288'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>efi</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='invtsc'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='rsba'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:   </features>
Nov 08 15:07:32 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 15:07:32 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:32 user nova-compute[74788]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 15:07:32 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:32 user nova-compute[74788]:   <machine>pc-i440fx-jammy</machine>
Nov 08 15:07:32 user nova-compute[74788]:   <arch>x86_64</arch>
Nov 08 15:07:32 user nova-compute[74788]:   <vcpu max='255'/>
Nov 08 15:07:32 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='firmware'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>efi</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </loader>
Nov 08 15:07:32 user nova-compute[74788]:   </os>
Nov 08 15:07:32 user nova-compute[74788]:   <cpu>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='invtsc'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='rsba'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:32 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm64</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>core2duo</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Westmere</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Penryn</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Opteron_G1</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Nehalem</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>Conroe</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:32 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:32 user nova-compute[74788]:     </mode>
Nov 08 15:07:32 user nova-compute[74788]:   </cpu>
Nov 08 15:07:32 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:32 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:32 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:32 user nova-compute[74788]:     </enum>
Nov 08 15:07:32 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:32 user nova-compute[74788]:   <devices>
Nov 08 15:07:32 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ide</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </disk>
Nov 08 15:07:32 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </graphics>
Nov 08 15:07:32 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </video>
Nov 08 15:07:32 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:32 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:32 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </rng>
Nov 08 15:07:32 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:32 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:32 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:32 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:32 user nova-compute[74788]:       </enum>
Nov 08 15:07:32 user nova-compute[74788]:     </tpm>
Nov 08 15:07:32 user nova-compute[74788]:   </devices>
Nov 08 15:07:32 user nova-compute[74788]:   <features>
Nov 08 15:07:32 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:32 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:32 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:33 user nova-compute[74788]:   </features>
Nov 08 15:07:33 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:33 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 15:07:33 user nova-compute[74788]: <domainCapabilities>
Nov 08 15:07:33 user nova-compute[74788]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 15:07:33 user nova-compute[74788]:   <domain>kvm</domain>
Nov 08 15:07:33 user nova-compute[74788]:   <machine>pc-i440fx-6.2</machine>
Nov 08 15:07:33 user nova-compute[74788]:   <arch>x86_64</arch>
Nov 08 15:07:33 user nova-compute[74788]:   <vcpu max='255'/>
Nov 08 15:07:33 user nova-compute[74788]:   <iothreads supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:   <os supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:     <enum name='firmware'>
Nov 08 15:07:33 user nova-compute[74788]:       <value>efi</value>
Nov 08 15:07:33 user nova-compute[74788]:     </enum>
Nov 08 15:07:33 user nova-compute[74788]:     <loader supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>rom</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>pflash</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='readonly'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>yes</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='secure'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>no</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </loader>
Nov 08 15:07:33 user nova-compute[74788]:   </os>
Nov 08 15:07:33 user nova-compute[74788]:   <cpu>
Nov 08 15:07:33 user nova-compute[74788]:     <mode name='host-passthrough' supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='hostPassthroughMigratable'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </mode>
Nov 08 15:07:33 user nova-compute[74788]:     <mode name='maximum' supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='maximumMigratable'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>on</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>off</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </mode>
Nov 08 15:07:33 user nova-compute[74788]:     <mode name='host-model' supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <vendor>Intel</vendor>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='ss'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='vmx'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='pcid'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='hypervisor'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='arat'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='umip'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='md-clear'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='stibp'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='ssbd'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='invtsc'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='ibpb'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='ibrs'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='amd-stibp'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='rsba'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='disable' name='erms'/>
Nov 08 15:07:33 user nova-compute[74788]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 15:07:33 user nova-compute[74788]:     </mode>
Nov 08 15:07:33 user nova-compute[74788]:     <mode name='custom' supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>qemu64</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>qemu32</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>phenom</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>pentium3</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>pentium2</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>pentium</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>n270</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>kvm64</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>kvm32</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>coreduo</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>core2duo</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>athlon</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Westmere</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Snowridge</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Server</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Skylake-Client</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>SandyBridge</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Penryn</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Opteron_G5</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Opteron_G4</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Opteron_G3</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Opteron_G2</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Opteron_G1</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Nehalem</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>IvyBridge</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Icelake-Server</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Haswell</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>EPYC-Rome</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>EPYC-Milan</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>EPYC</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Dhyana</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Cooperlake</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>Conroe</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='no'>Broadwell</model>
Nov 08 15:07:33 user nova-compute[74788]:       <model usable='yes'>486</model>
Nov 08 15:07:33 user nova-compute[74788]:     </mode>
Nov 08 15:07:33 user nova-compute[74788]:   </cpu>
Nov 08 15:07:33 user nova-compute[74788]:   <memoryBacking supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:     <enum name='sourceType'>
Nov 08 15:07:33 user nova-compute[74788]:       <value>file</value>
Nov 08 15:07:33 user nova-compute[74788]:       <value>anonymous</value>
Nov 08 15:07:33 user nova-compute[74788]:       <value>memfd</value>
Nov 08 15:07:33 user nova-compute[74788]:     </enum>
Nov 08 15:07:33 user nova-compute[74788]:   </memoryBacking>
Nov 08 15:07:33 user nova-compute[74788]:   <devices>
Nov 08 15:07:33 user nova-compute[74788]:     <disk supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='diskDevice'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>disk</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>cdrom</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>floppy</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>lun</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='bus'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>ide</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>fdc</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>sata</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </disk>
Nov 08 15:07:33 user nova-compute[74788]:     <graphics supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='type'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>sdl</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>vnc</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>spice</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>egl-headless</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </graphics>
Nov 08 15:07:33 user nova-compute[74788]:     <video supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='modelType'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>vga</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>cirrus</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>vmvga</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>qxl</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>none</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>bochs</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>ramfb</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </video>
Nov 08 15:07:33 user nova-compute[74788]:     <hostdev supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='mode'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>subsystem</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='startupPolicy'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>default</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>mandatory</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>requisite</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>optional</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='subsysType'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>usb</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>pci</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>scsi</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='capsType'/>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='pciBackend'/>
Nov 08 15:07:33 user nova-compute[74788]:     </hostdev>
Nov 08 15:07:33 user nova-compute[74788]:     <rng supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio-transitional</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtio-non-transitional</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>random</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>egd</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>builtin</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </rng>
Nov 08 15:07:33 user nova-compute[74788]:     <filesystem supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='driverType'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>path</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>handle</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>virtiofs</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </filesystem>
Nov 08 15:07:33 user nova-compute[74788]:     <tpm supported='yes'>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='model'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>tpm-tis</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>tpm-crb</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:       <enum name='backendModel'>
Nov 08 15:07:33 user nova-compute[74788]:         <value>passthrough</value>
Nov 08 15:07:33 user nova-compute[74788]:         <value>emulator</value>
Nov 08 15:07:33 user nova-compute[74788]:       </enum>
Nov 08 15:07:33 user nova-compute[74788]:     </tpm>
Nov 08 15:07:33 user nova-compute[74788]:   </devices>
Nov 08 15:07:33 user nova-compute[74788]:   <features>
Nov 08 15:07:33 user nova-compute[74788]:     <gic supported='no'/>
Nov 08 15:07:33 user nova-compute[74788]:     <vmcoreinfo supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <genid supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <backingStoreInput supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <backup supported='yes'/>
Nov 08 15:07:33 user nova-compute[74788]:     <sev supported='no'/>
Nov 08 15:07:33 user nova-compute[74788]:   </features>
Nov 08 15:07:33 user nova-compute[74788]: </domainCapabilities>
Nov 08 15:07:33 user nova-compute[74788]:  {{(pid=74788) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74788) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74788) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Checking secure boot support for host arch (x86_64) {{(pid=74788) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Secure Boot support detected
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] cpu compare xml: <cpu match="exact">
Nov 08 15:07:33 user nova-compute[74788]:   <model>Nehalem</model>
Nov 08 15:07:33 user nova-compute[74788]: </cpu>
Nov 08 15:07:33 user nova-compute[74788]:  {{(pid=74788) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.virt.node [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Generated node identity e3449262-5ea3-41b5-a9f5-efda3df45537
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.virt.node [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Wrote node identity e3449262-5ea3-41b5-a9f5-efda3df45537 to /opt/stack/data/nova/compute_id
Nov 08 15:07:33 user nova-compute[74788]: WARNING nova.compute.manager [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Compute nodes ['e3449262-5ea3-41b5-a9f5-efda3df45537'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.compute.manager [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 15:07:33 user nova-compute[74788]: WARNING nova.compute.manager [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 15:07:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:07:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:07:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Hypervisor/Node resource view: name=user free_ram=11009MB free_disk=26.289600372314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:07:33 user nova-compute[74788]: WARNING nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] No compute node record for user:e3449262-5ea3-41b5-a9f5-efda3df45537: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e3449262-5ea3-41b5-a9f5-efda3df45537 could not be found.
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Compute node record created for user:user with uuid: e3449262-5ea3-41b5-a9f5-efda3df45537
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] [req-52ac90cd-2573-48ee-b2f3-24994a7a40ce] Created resource provider record via placement API for resource provider with UUID e3449262-5ea3-41b5-a9f5-efda3df45537 and name user.
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74788) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 15:07:33 user nova-compute[74788]: INFO nova.virt.libvirt.host [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] kernel doesn't support AMD SEV
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Libvirt baseline CPU <cpu>
Nov 08 15:07:33 user nova-compute[74788]:   <arch>x86_64</arch>
Nov 08 15:07:33 user nova-compute[74788]:   <model>Nehalem</model>
Nov 08 15:07:33 user nova-compute[74788]:   <vendor>Intel</vendor>
Nov 08 15:07:33 user nova-compute[74788]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 15:07:33 user nova-compute[74788]: </cpu>
Nov 08 15:07:33 user nova-compute[74788]:  {{(pid=74788) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Updated inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Updating resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 generation from 0 to 1 during operation: update_inventory {{(pid=74788) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 15:07:33 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Updating resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 generation from 1 to 2 during operation: update_traits {{(pid=74788) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG nova.service [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Creating RPC server for service compute {{(pid=74788) start /opt/stack/nova/nova/service.py:182}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG nova.service [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] Join ServiceGroup membership for this service compute {{(pid=74788) start /opt/stack/nova/nova/service.py:199}}
Nov 08 15:07:34 user nova-compute[74788]: DEBUG nova.servicegroup.drivers.db [None req-820dc2e9-20d5-4dbd-a57e-344804d001aa None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74788) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 15:07:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:07:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:08:24 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:08:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:08:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=10449MB free_disk=26.193355560302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:09:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:09:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:09:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=10363MB free_disk=26.257442474365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:09:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:10:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:10:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:10:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=10391MB free_disk=26.010223388671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:10:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:10:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:10:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:11:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:27 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9640MB free_disk=26.03786849975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:11:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:11:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:11:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:11:41 user nova-compute[74788]: INFO nova.compute.claims [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Claim successful on node user
Nov 08 15:11:41 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:11:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:11:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Creating image(s)
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.policy [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4cd49810cc347279c7f97ab21bc9e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4931b5b5c3724596ae964178f6683416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.virt.images [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] 04773e08-e579-43f8-a159-498093451850 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.part /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.part /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.converted" returned: 0 in 0.161s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.790s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:43 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnpmuezsj/privsep.sock']
Nov 08 15:11:43 user sudo[84060]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnpmuezsj/privsep.sock
Nov 08 15:11:43 user sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 15:11:44 user sudo[84060]: pam_unix(sudo:session): session closed for user root
Nov 08 15:11:44 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Spawned new privsep daemon via rootwrap
Nov 08 15:11:44 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 15:11:44 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 15:11:44 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 15:11:44 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84063
Nov 08 15:11:44 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Successfully created port: 210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:11:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk 1073741824" returned: 0 in 0.052s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Cannot resize image /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Ensure instance console log exists: /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:11:46 user nova-compute[74788]: INFO nova.compute.claims [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Claim successful on node user
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:11:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:11:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Creating image(s)
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:46 user nova-compute[74788]: DEBUG nova.policy [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649a41ab82754c269c03606c18428b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7984a5e14b104fdbbe50c0171702b765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.222s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk 1073741824" returned: 0 in 0.060s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Successfully updated port: 210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Cannot resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Ensure instance console log exists: /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-changed-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Refreshing instance network info cache due to event network-changed-210c398c-b530-47f9-9e1b-e8d1b41f6389. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance network_info: |[{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Refreshing network info cache for port 210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start _get_guest_xml network_info=[{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:11:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.objects.instance [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:11:48 user nova-compute[74788]:   <uuid>4d4cedbd-4e31-4aad-a580-da6aded0134f</uuid>
Nov 08 15:11:48 user nova-compute[74788]:   <name>instance-00000001</name>
Nov 08 15:11:48 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:11:48 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:11:48 user nova-compute[74788]:   <metadata>
Nov 08 15:11:48 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:11:48 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherB-server-1076661114</nova:name>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:11:48</nova:creationTime>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:11:48 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:11:48 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:owner>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:user uuid="c4cd49810cc347279c7f97ab21bc9e36">tempest-ServerActionsTestOtherB-108483217-project-member</nova:user>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:project uuid="4931b5b5c3724596ae964178f6683416">tempest-ServerActionsTestOtherB-108483217</nova:project>
Nov 08 15:11:48 user nova-compute[74788]:       </nova:owner>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:11:48 user nova-compute[74788]:       <nova:ports>
Nov 08 15:11:48 user nova-compute[74788]:         <nova:port uuid="210c398c-b530-47f9-9e1b-e8d1b41f6389">
Nov 08 15:11:48 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:11:48 user nova-compute[74788]:         </nova:port>
Nov 08 15:11:48 user nova-compute[74788]:       </nova:ports>
Nov 08 15:11:48 user nova-compute[74788]:     </nova:instance>
Nov 08 15:11:48 user nova-compute[74788]:   </metadata>
Nov 08 15:11:48 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:11:48 user nova-compute[74788]:     <system>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="serial">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="uuid">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:11:48 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:11:48 user nova-compute[74788]:     </system>
Nov 08 15:11:48 user nova-compute[74788]:   </sysinfo>
Nov 08 15:11:48 user nova-compute[74788]:   <os>
Nov 08 15:11:48 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:11:48 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:11:48 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:11:48 user nova-compute[74788]:   </os>
Nov 08 15:11:48 user nova-compute[74788]:   <features>
Nov 08 15:11:48 user nova-compute[74788]:     <acpi/>
Nov 08 15:11:48 user nova-compute[74788]:     <apic/>
Nov 08 15:11:48 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:11:48 user nova-compute[74788]:   </features>
Nov 08 15:11:48 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:11:48 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:11:48 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:11:48 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:11:48 user nova-compute[74788]:   </clock>
Nov 08 15:11:48 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:11:48 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:11:48 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:11:48 user nova-compute[74788]:   </cpu>
Nov 08 15:11:48 user nova-compute[74788]:   <devices>
Nov 08 15:11:48 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:11:48 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:11:48 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk"/>
Nov 08 15:11:48 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:11:48 user nova-compute[74788]:     </disk>
Nov 08 15:11:48 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:11:48 user nova-compute[74788]:       <mac address="fa:16:3e:31:6b:13"/>
Nov 08 15:11:48 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:11:48 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:11:48 user nova-compute[74788]:       <target dev="tap210c398c-b5"/>
Nov 08 15:11:48 user nova-compute[74788]:     </interface>
Nov 08 15:11:48 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:11:48 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/console.log" append="off"/>
Nov 08 15:11:48 user nova-compute[74788]:     </serial>
Nov 08 15:11:48 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:11:48 user nova-compute[74788]:     <video>
Nov 08 15:11:48 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:11:48 user nova-compute[74788]:     </video>
Nov 08 15:11:48 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:11:48 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:11:48 user nova-compute[74788]:     </rng>
Nov 08 15:11:48 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:11:48 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:11:48 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:11:48 user nova-compute[74788]:     </memballoon>
Nov 08 15:11:48 user nova-compute[74788]:   </devices>
Nov 08 15:11:48 user nova-compute[74788]: </domain>
Nov 08 15:11:48 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG os_vif [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Created schema index Interface.name {{(pid=74788) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Created schema index Port.name {{(pid=74788) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Created schema index Bridge.name {{(pid=74788) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [POLLOUT] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Successfully created port: 64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc4a5a5-ebd3-55c5-9d8c-9f1b6117bd78', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:11:49 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmps_6xm_bu/privsep.sock']
Nov 08 15:11:49 user sudo[84120]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmps_6xm_bu/privsep.sock
Nov 08 15:11:49 user sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 15:11:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updated VIF entry in instance network info cache for port 210c398c-b530-47f9-9e1b-e8d1b41f6389. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:11:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-08ef2e3a-2849-4540-b938-b490dd8cbe60 req-8b72a923-385b-4934-8816-fb6d8da19f83 service nova] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:11:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:50 user sudo[84120]: pam_unix(sudo:session): session closed for user root
Nov 08 15:11:50 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Spawned new privsep daemon via rootwrap
Nov 08 15:11:50 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 15:11:50 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 15:11:50 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 15:11:50 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84123
Nov 08 15:11:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap210c398c-b5, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap210c398c-b5, col_values=(('qos', UUID('76686883-d09f-42bd-8e3f-0b9856f434ac')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap210c398c-b5, col_values=(('external_ids', {'iface-id': '210c398c-b530-47f9-9e1b-e8d1b41f6389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:6b:13', 'vm-uuid': '4d4cedbd-4e31-4aad-a580-da6aded0134f'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:51 user nova-compute[74788]: INFO os_vif [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No VIF found with MAC fa:16:3e:31:6b:13, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Successfully updated port: 64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-changed-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Refreshing instance network info cache due to event network-changed-64118033-36fd-4778-a574-53d4a32ec9c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:11:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.neutron [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance network_info: |[{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Refreshing network info cache for port 64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start _get_guest_xml network_info=[{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:11:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.objects.instance [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:11:52 user nova-compute[74788]:   <uuid>16d4b216-2642-4df7-b0dd-a8b7da36b88e</uuid>
Nov 08 15:11:52 user nova-compute[74788]:   <name>instance-00000002</name>
Nov 08 15:11:52 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:11:52 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:11:52 user nova-compute[74788]:   <metadata>
Nov 08 15:11:52 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:11:52 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeTestJSON-server-70773012</nova:name>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:11:52</nova:creationTime>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:11:52 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:11:52 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:owner>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:user uuid="649a41ab82754c269c03606c18428b86">tempest-AttachVolumeTestJSON-1302335670-project-member</nova:user>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:project uuid="7984a5e14b104fdbbe50c0171702b765">tempest-AttachVolumeTestJSON-1302335670</nova:project>
Nov 08 15:11:52 user nova-compute[74788]:       </nova:owner>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:11:52 user nova-compute[74788]:       <nova:ports>
Nov 08 15:11:52 user nova-compute[74788]:         <nova:port uuid="64118033-36fd-4778-a574-53d4a32ec9c1">
Nov 08 15:11:52 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:11:52 user nova-compute[74788]:         </nova:port>
Nov 08 15:11:52 user nova-compute[74788]:       </nova:ports>
Nov 08 15:11:52 user nova-compute[74788]:     </nova:instance>
Nov 08 15:11:52 user nova-compute[74788]:   </metadata>
Nov 08 15:11:52 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:11:52 user nova-compute[74788]:     <system>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="serial">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="uuid">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:11:52 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:11:52 user nova-compute[74788]:     </system>
Nov 08 15:11:52 user nova-compute[74788]:   </sysinfo>
Nov 08 15:11:52 user nova-compute[74788]:   <os>
Nov 08 15:11:52 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:11:52 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:11:52 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:11:52 user nova-compute[74788]:   </os>
Nov 08 15:11:52 user nova-compute[74788]:   <features>
Nov 08 15:11:52 user nova-compute[74788]:     <acpi/>
Nov 08 15:11:52 user nova-compute[74788]:     <apic/>
Nov 08 15:11:52 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:11:52 user nova-compute[74788]:   </features>
Nov 08 15:11:52 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:11:52 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:11:52 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:11:52 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:11:52 user nova-compute[74788]:   </clock>
Nov 08 15:11:52 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:11:52 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:11:52 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:11:52 user nova-compute[74788]:   </cpu>
Nov 08 15:11:52 user nova-compute[74788]:   <devices>
Nov 08 15:11:52 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:11:52 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:11:52 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk"/>
Nov 08 15:11:52 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:11:52 user nova-compute[74788]:     </disk>
Nov 08 15:11:52 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:11:52 user nova-compute[74788]:       <mac address="fa:16:3e:35:3e:45"/>
Nov 08 15:11:52 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:11:52 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:11:52 user nova-compute[74788]:       <target dev="tap64118033-36"/>
Nov 08 15:11:52 user nova-compute[74788]:     </interface>
Nov 08 15:11:52 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:11:52 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/console.log" append="off"/>
Nov 08 15:11:52 user nova-compute[74788]:     </serial>
Nov 08 15:11:52 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:11:52 user nova-compute[74788]:     <video>
Nov 08 15:11:52 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:11:52 user nova-compute[74788]:     </video>
Nov 08 15:11:52 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:11:52 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:11:52 user nova-compute[74788]:     </rng>
Nov 08 15:11:52 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:11:52 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:11:52 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:11:52 user nova-compute[74788]:     </memballoon>
Nov 08 15:11:52 user nova-compute[74788]:   </devices>
Nov 08 15:11:52 user nova-compute[74788]: </domain>
Nov 08 15:11:52 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG os_vif [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbcf4317-c202-50ae-8943-fd435724e94e', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64118033-36, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64118033-36, col_values=(('qos', UUID('84e843a1-b43b-495a-a62f-c0e7c5d0ae4a')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64118033-36, col_values=(('external_ids', {'iface-id': '64118033-36fd-4778-a574-53d4a32ec9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3e:45', 'vm-uuid': '16d4b216-2642-4df7-b0dd-a8b7da36b88e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: INFO os_vif [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No VIF found with MAC fa:16:3e:35:3e:45, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:11:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updated VIF entry in instance network info cache for port 64118033-36fd-4778-a574-53d4a32ec9c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ee583de-3b8b-43aa-b6bc-4f6189ecb4c8 req-a755984f-b622-4bfb-8533-0371a0161176 service nova] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:11:54 user nova-compute[74788]: INFO nova.compute.claims [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Claim successful on node user
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:11:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:11:54 user nova-compute[74788]: DEBUG nova.policy [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946d9aeee5664b8c8f2c2e09604df6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9989f0594d764f1b95aa6ee59d9b65ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:11:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Creating image(s)
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "/opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "/opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "/opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.308s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.295s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk 1073741824" returned: 0 in 0.061s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.290s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Cannot resize image /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Ensure instance console log exists: /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:11:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance spawned successfully.
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:56 user nova-compute[74788]: INFO nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Took 14.62 seconds to spawn the instance on the hypervisor.
Nov 08 15:11:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:11:57 user nova-compute[74788]: INFO nova.compute.manager [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Took 15.69 seconds to build instance.
Nov 08 15:11:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fb8ef75c-d1a3-4d06-991e-e2f9eaf7996f tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.467s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:11:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance spawned successfully.
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:11:57 user nova-compute[74788]: INFO nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Took 10.97 seconds to spawn the instance on the hypervisor.
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:11:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Successfully created port: 95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:11:57 user nova-compute[74788]: INFO nova.compute.manager [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Took 11.97 seconds to build instance.
Nov 08 15:11:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-31955eb4-0b5a-427d-a8b1-77a7e16802ba tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.122s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Successfully updated port: 95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquired lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-changed-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Refreshing instance network info cache due to event network-changed-95b82f6a-a3fb-471e-9806-04a5dd098e47. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] Acquiring lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating instance_info_cache with network_info: [{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Releasing lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Instance network_info: |[{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] Acquired lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Refreshing network info cache for port 95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Start _get_guest_xml network_info=[{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:12:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1666466500',display_name='tempest-VolumesAdminNegativeTest-server-1666466500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1666466500',id=3,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj6JO4tWGQMc+z8RsXRxxJC8QpdFq1GoR1D+M+p7pkL6nv3eLx+EcpVviIjAGt96kdw5/9bSJ9eLSYyMC++gvWMYLQga6QwuSjrT70DhbkRbkBLNImBr37GQlRFt93Eng==',key_name='tempest-keypair-851874093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-ucxmyf10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=966892ee-94c8-442e-911d-54941e0efdbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'pci_devices' on Instance uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:12:01 user nova-compute[74788]:   <uuid>966892ee-94c8-442e-911d-54941e0efdbd</uuid>
Nov 08 15:12:01 user nova-compute[74788]:   <name>instance-00000003</name>
Nov 08 15:12:01 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:12:01 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:12:01 user nova-compute[74788]:   <metadata>
Nov 08 15:12:01 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:12:01 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1666466500</nova:name>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:12:01</nova:creationTime>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:12:01 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:12:01 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:owner>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:user uuid="946d9aeee5664b8c8f2c2e09604df6da">tempest-VolumesAdminNegativeTest-571382466-project-member</nova:user>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:project uuid="9989f0594d764f1b95aa6ee59d9b65ea">tempest-VolumesAdminNegativeTest-571382466</nova:project>
Nov 08 15:12:01 user nova-compute[74788]:       </nova:owner>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:12:01 user nova-compute[74788]:       <nova:ports>
Nov 08 15:12:01 user nova-compute[74788]:         <nova:port uuid="95b82f6a-a3fb-471e-9806-04a5dd098e47">
Nov 08 15:12:01 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 15:12:01 user nova-compute[74788]:         </nova:port>
Nov 08 15:12:01 user nova-compute[74788]:       </nova:ports>
Nov 08 15:12:01 user nova-compute[74788]:     </nova:instance>
Nov 08 15:12:01 user nova-compute[74788]:   </metadata>
Nov 08 15:12:01 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:12:01 user nova-compute[74788]:     <system>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="serial">966892ee-94c8-442e-911d-54941e0efdbd</entry>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="uuid">966892ee-94c8-442e-911d-54941e0efdbd</entry>
Nov 08 15:12:01 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:12:01 user nova-compute[74788]:     </system>
Nov 08 15:12:01 user nova-compute[74788]:   </sysinfo>
Nov 08 15:12:01 user nova-compute[74788]:   <os>
Nov 08 15:12:01 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:12:01 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:12:01 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:12:01 user nova-compute[74788]:   </os>
Nov 08 15:12:01 user nova-compute[74788]:   <features>
Nov 08 15:12:01 user nova-compute[74788]:     <acpi/>
Nov 08 15:12:01 user nova-compute[74788]:     <apic/>
Nov 08 15:12:01 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:12:01 user nova-compute[74788]:   </features>
Nov 08 15:12:01 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:12:01 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:12:01 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:12:01 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:12:01 user nova-compute[74788]:   </clock>
Nov 08 15:12:01 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:12:01 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:12:01 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:12:01 user nova-compute[74788]:   </cpu>
Nov 08 15:12:01 user nova-compute[74788]:   <devices>
Nov 08 15:12:01 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:12:01 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:12:01 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk"/>
Nov 08 15:12:01 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:12:01 user nova-compute[74788]:     </disk>
Nov 08 15:12:01 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:12:01 user nova-compute[74788]:       <mac address="fa:16:3e:f3:c6:cf"/>
Nov 08 15:12:01 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:01 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:12:01 user nova-compute[74788]:       <target dev="tap95b82f6a-a3"/>
Nov 08 15:12:01 user nova-compute[74788]:     </interface>
Nov 08 15:12:01 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:12:01 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/console.log" append="off"/>
Nov 08 15:12:01 user nova-compute[74788]:     </serial>
Nov 08 15:12:01 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:12:01 user nova-compute[74788]:     <video>
Nov 08 15:12:01 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:01 user nova-compute[74788]:     </video>
Nov 08 15:12:01 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:12:01 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:12:01 user nova-compute[74788]:     </rng>
Nov 08 15:12:01 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:12:01 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:12:01 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:12:01 user nova-compute[74788]:     </memballoon>
Nov 08 15:12:01 user nova-compute[74788]:   </devices>
Nov 08 15:12:01 user nova-compute[74788]: </domain>
Nov 08 15:12:01 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1666466500',display_name='tempest-VolumesAdminNegativeTest-server-1666466500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1666466500',id=3,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj6JO4tWGQMc+z8RsXRxxJC8QpdFq1GoR1D+M+p7pkL6nv3eLx+EcpVviIjAGt96kdw5/9bSJ9eLSYyMC++gvWMYLQga6QwuSjrT70DhbkRbkBLNImBr37GQlRFt93Eng==',key_name='tempest-keypair-851874093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-ucxmyf10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=966892ee-94c8-442e-911d-54941e0efdbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG os_vif [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a91b08e9-7ec1-5041-a599-df548f42d176', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95b82f6a-a3, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95b82f6a-a3, col_values=(('qos', UUID('f52e5b48-4b19-46df-b45b-0bdfebaa68a1')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95b82f6a-a3, col_values=(('external_ids', {'iface-id': '95b82f6a-a3fb-471e-9806-04a5dd098e47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:c6:cf', 'vm-uuid': '966892ee-94c8-442e-911d-54941e0efdbd'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: INFO os_vif [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3')
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No VIF found with MAC fa:16:3e:f3:c6:cf, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updated VIF entry in instance network info cache for port 95b82f6a-a3fb-471e-9806-04a5dd098e47. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating instance_info_cache with network_info: [{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d06795a-e32b-43ab-9f7f-724f30e6370f req-bcc2f1a7-6e9d-455b-b973-c763e75fb8ea service nova] Releasing lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:12:05 user nova-compute[74788]: INFO nova.compute.claims [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Claim successful on node user
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:12:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Instance spawned successfully.
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:12:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:12:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:12:06 user nova-compute[74788]: INFO nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Took 10.99 seconds to spawn the instance on the hypervisor.
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.policy [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3501913624bff879d18820e90e542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbb9646cb224477b6f2a301c789af80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:06 user nova-compute[74788]: INFO nova.compute.manager [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Took 12.11 seconds to build instance.
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ea046c-5986-42c5-aa9d-5a7dc1b05e8f tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.261s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:12:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Creating image(s)
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Successfully created port: d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:12:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.part --force-share --output=json" returned: 0 in 0.291s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.virt.images [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] 2084bf8e-c7ad-41a0-b25f-8d175e481e32 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.part /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.part /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.converted" returned: 0 in 0.267s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56.converted --force-share --output=json" returned: 0 in 0.261s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.358s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Successfully updated port: d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json" returned: 0 in 0.233s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquired lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-changed-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Refreshing instance network info cache due to event network-changed-d62b0b42-b510-4a5d-ba8e-f126417897ff. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] Acquiring lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json" returned: 0 in 0.221s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56,backing_fmt=raw /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56,backing_fmt=raw /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk 1073741824" returned: 0 in 0.054s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "c234acb601dd80fe8287b7a4da95abe1b5703f56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Cannot resize image /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Releasing lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Instance network_info: |[{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] Acquired lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.neutron [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Refreshing network info cache for port d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Start _get_guest_xml network_info=[{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:11:56Z,direct_url=<?>,disk_format='qcow2',id=2084bf8e-c7ad-41a0-b25f-8d175e481e32,min_disk=0,min_ram=0,name='',owner='b2755b663ae2460fba4198b37c5a157f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:11:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '2084bf8e-c7ad-41a0-b25f-8d175e481e32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:12:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:11:56Z,direct_url=<?>,disk_format='qcow2',id=2084bf8e-c7ad-41a0-b25f-8d175e481e32,min_disk=0,min_ram=0,name='',owner='b2755b663ae2460fba4198b37c5a157f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:11:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903341689',display_name='tempest-AttachSCSIVolumeTestJSON-server-903341689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903341689',id=4,image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0fJmDYiWWbvcP41NcYlDaeXH0+1EpT6wy92TLlWxnX/3rgZun2cQeq7f2bPeSin/gysP8nFgqeF6xuwtbojXO8tBf8/n2+UwrY8QUl3oFNQWus1+0RxVxHFSkmnR/Dng==',key_name='tempest-keypair-400943787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbb9646cb224477b6f2a301c789af80',ramdisk_id='',reservation_id='r-qz7dvk4k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20892047',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20892047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50e3501913624bff879d18820e90e542',uuid=8880bfb1-f356-4e45-b6e8-06eba6d41cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converting VIF {"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lazy-loading 'pci_devices' on Instance uuid 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:12:08 user nova-compute[74788]:   <uuid>8880bfb1-f356-4e45-b6e8-06eba6d41cf9</uuid>
Nov 08 15:12:08 user nova-compute[74788]:   <name>instance-00000004</name>
Nov 08 15:12:08 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:12:08 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:12:08 user nova-compute[74788]:   <metadata>
Nov 08 15:12:08 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:12:08 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-903341689</nova:name>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:12:08</nova:creationTime>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:12:08 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:12:08 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:owner>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:user uuid="50e3501913624bff879d18820e90e542">tempest-AttachSCSIVolumeTestJSON-20892047-project-member</nova:user>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:project uuid="ecbb9646cb224477b6f2a301c789af80">tempest-AttachSCSIVolumeTestJSON-20892047</nova:project>
Nov 08 15:12:08 user nova-compute[74788]:       </nova:owner>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:root type="image" uuid="2084bf8e-c7ad-41a0-b25f-8d175e481e32"/>
Nov 08 15:12:08 user nova-compute[74788]:       <nova:ports>
Nov 08 15:12:08 user nova-compute[74788]:         <nova:port uuid="d62b0b42-b510-4a5d-ba8e-f126417897ff">
Nov 08 15:12:08 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 15:12:08 user nova-compute[74788]:         </nova:port>
Nov 08 15:12:08 user nova-compute[74788]:       </nova:ports>
Nov 08 15:12:08 user nova-compute[74788]:     </nova:instance>
Nov 08 15:12:08 user nova-compute[74788]:   </metadata>
Nov 08 15:12:08 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:12:08 user nova-compute[74788]:     <system>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="serial">8880bfb1-f356-4e45-b6e8-06eba6d41cf9</entry>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="uuid">8880bfb1-f356-4e45-b6e8-06eba6d41cf9</entry>
Nov 08 15:12:08 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:12:08 user nova-compute[74788]:     </system>
Nov 08 15:12:08 user nova-compute[74788]:   </sysinfo>
Nov 08 15:12:08 user nova-compute[74788]:   <os>
Nov 08 15:12:08 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:12:08 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:12:08 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:12:08 user nova-compute[74788]:   </os>
Nov 08 15:12:08 user nova-compute[74788]:   <features>
Nov 08 15:12:08 user nova-compute[74788]:     <acpi/>
Nov 08 15:12:08 user nova-compute[74788]:     <apic/>
Nov 08 15:12:08 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:12:08 user nova-compute[74788]:   </features>
Nov 08 15:12:08 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:12:08 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:12:08 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:12:08 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:12:08 user nova-compute[74788]:   </clock>
Nov 08 15:12:08 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:12:08 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:12:08 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:12:08 user nova-compute[74788]:   </cpu>
Nov 08 15:12:08 user nova-compute[74788]:   <devices>
Nov 08 15:12:08 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:12:08 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:12:08 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk"/>
Nov 08 15:12:08 user nova-compute[74788]:       <target dev="sda" bus="scsi"/>
Nov 08 15:12:08 user nova-compute[74788]:       <address type="drive" controller="0" unit="0"/>
Nov 08 15:12:08 user nova-compute[74788]:     </disk>
Nov 08 15:12:08 user nova-compute[74788]:     <disk type="file" device="cdrom">
Nov 08 15:12:08 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 15:12:08 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.config"/>
Nov 08 15:12:08 user nova-compute[74788]:       <target dev="sdb" bus="scsi"/>
Nov 08 15:12:08 user nova-compute[74788]:       <address type="drive" controller="0" unit="1"/>
Nov 08 15:12:08 user nova-compute[74788]:     </disk>
Nov 08 15:12:08 user nova-compute[74788]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 15:12:08 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:12:08 user nova-compute[74788]:       <mac address="fa:16:3e:de:a7:ee"/>
Nov 08 15:12:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:08 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:12:08 user nova-compute[74788]:       <target dev="tapd62b0b42-b5"/>
Nov 08 15:12:08 user nova-compute[74788]:     </interface>
Nov 08 15:12:08 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:12:08 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/console.log" append="off"/>
Nov 08 15:12:08 user nova-compute[74788]:     </serial>
Nov 08 15:12:08 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:12:08 user nova-compute[74788]:     <video>
Nov 08 15:12:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:08 user nova-compute[74788]:     </video>
Nov 08 15:12:08 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:12:08 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:12:08 user nova-compute[74788]:     </rng>
Nov 08 15:12:08 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:12:08 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:12:08 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:12:08 user nova-compute[74788]:     </memballoon>
Nov 08 15:12:08 user nova-compute[74788]:   </devices>
Nov 08 15:12:08 user nova-compute[74788]: </domain>
Nov 08 15:12:08 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903341689',display_name='tempest-AttachSCSIVolumeTestJSON-server-903341689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903341689',id=4,image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0fJmDYiWWbvcP41NcYlDaeXH0+1EpT6wy92TLlWxnX/3rgZun2cQeq7f2bPeSin/gysP8nFgqeF6xuwtbojXO8tBf8/n2+UwrY8QUl3oFNQWus1+0RxVxHFSkmnR/Dng==',key_name='tempest-keypair-400943787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbb9646cb224477b6f2a301c789af80',ramdisk_id='',reservation_id='r-qz7dvk4k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20892047',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20892047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50e3501913624bff879d18820e90e542',uuid=8880bfb1-f356-4e45-b6e8-06eba6d41cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converting VIF {"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG os_vif [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc9dcc0f-73ec-5b69-84c8-a334f504ca8f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd62b0b42-b5, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd62b0b42-b5, col_values=(('qos', UUID('ed059473-191a-4b0b-a82a-f7113cfe38b2')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd62b0b42-b5, col_values=(('external_ids', {'iface-id': 'd62b0b42-b510-4a5d-ba8e-f126417897ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a7:ee', 'vm-uuid': '8880bfb1-f356-4e45-b6e8-06eba6d41cf9'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:08 user nova-compute[74788]: INFO os_vif [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5')
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] No BDM found with device name sda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] No VIF found with MAC fa:16:3e:de:a7:ee, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:12:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Using config drive
Nov 08 15:12:09 user nova-compute[74788]: DEBUG nova.network.neutron [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updated VIF entry in instance network info cache for port d62b0b42-b510-4a5d-ba8e-f126417897ff. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG nova.network.neutron [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-01c3442e-c49d-4657-b843-9472bbfb9402 req-a9735429-1f81-4448-8f9c-7c8e2283a8e9 service nova] Releasing lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Creating config drive at /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.config
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq9pdwgka {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq9pdwgka" returned: 0 in 0.056s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:12:09 user nova-compute[74788]: INFO nova.compute.claims [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Claim successful on node user
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:10 user nova-compute[74788]: WARNING nova.compute.manager [req-d07920dd-f908-4fdd-8ec8-70bc6f322068 req-44152ae4-38aa-45ec-a168-f36526c68afa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state active and task_state None.
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.817s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:12:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:12:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG nova.policy [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649cb7a8623d4a70933af2e4742921ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a360ac3974426b6f6aea8e48dcfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:12:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Creating image(s)
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.236s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.282s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk 1073741824" returned: 0 in 0.071s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.312s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Cannot resize image /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Ensure instance console log exists: /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:12 user nova-compute[74788]: WARNING nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state active and task_state None.
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] No waiting events found dispatching network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:12 user nova-compute[74788]: WARNING nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received unexpected event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 for instance with vm_state active and task_state None.
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] No waiting events found dispatching network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:12 user nova-compute[74788]: WARNING nova.compute.manager [req-a9c1561f-1d78-47b2-953d-e5b5de712b27 req-a6334412-a258-4bd8-adcb-b5d59a1e7378 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received unexpected event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 for instance with vm_state active and task_state None.
Nov 08 15:12:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Successfully created port: 2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:13 user nova-compute[74788]: WARNING nova.compute.manager [req-80501844-d36d-45e5-ad87-bf43db1bd8ce req-7f391d3d-45b4-4428-a649-94f0645207bf service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state None.
Nov 08 15:12:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:12:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Instance spawned successfully.
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.compute.claims [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Claim successful on node user
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Successfully updated port: 2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.compute.manager [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Took 9.32 seconds to build instance.
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c257bebf-17ae-429e-b3df-198ce7cdc9c6 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.467s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.policy [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b172221dfe874ddc8635edb474d8c599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1571ef1f543a4537a4d1c50d9aeaa5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:12:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Creating image(s)
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "/opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "/opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.023s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Instance network_info: |[{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Start _get_guest_xml network_info=[{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:12:15 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:15 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:12:15 user nova-compute[74788]:   <uuid>9b540dd4-ac0f-41a2-941a-a7dd519d2922</uuid>
Nov 08 15:12:15 user nova-compute[74788]:   <name>instance-00000005</name>
Nov 08 15:12:15 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:12:15 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:12:15 user nova-compute[74788]:   <metadata>
Nov 08 15:12:15 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:12:15 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:12:15</nova:creationTime>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:12:15 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:12:15 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:owner>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:12:15 user nova-compute[74788]:       </nova:owner>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:12:15 user nova-compute[74788]:       <nova:ports>
Nov 08 15:12:15 user nova-compute[74788]:         <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:12:15 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:12:15 user nova-compute[74788]:         </nova:port>
Nov 08 15:12:15 user nova-compute[74788]:       </nova:ports>
Nov 08 15:12:15 user nova-compute[74788]:     </nova:instance>
Nov 08 15:12:15 user nova-compute[74788]:   </metadata>
Nov 08 15:12:15 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:12:15 user nova-compute[74788]:     <system>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="serial">9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="uuid">9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:12:15 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:12:15 user nova-compute[74788]:     </system>
Nov 08 15:12:15 user nova-compute[74788]:   </sysinfo>
Nov 08 15:12:15 user nova-compute[74788]:   <os>
Nov 08 15:12:15 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:12:15 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:12:15 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:12:15 user nova-compute[74788]:   </os>
Nov 08 15:12:15 user nova-compute[74788]:   <features>
Nov 08 15:12:15 user nova-compute[74788]:     <acpi/>
Nov 08 15:12:15 user nova-compute[74788]:     <apic/>
Nov 08 15:12:15 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:12:15 user nova-compute[74788]:   </features>
Nov 08 15:12:15 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:12:15 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:12:15 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:12:15 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:12:15 user nova-compute[74788]:   </clock>
Nov 08 15:12:15 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:12:15 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:12:15 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:12:15 user nova-compute[74788]:   </cpu>
Nov 08 15:12:15 user nova-compute[74788]:   <devices>
Nov 08 15:12:15 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:12:15 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:12:15 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk"/>
Nov 08 15:12:15 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:12:15 user nova-compute[74788]:     </disk>
Nov 08 15:12:15 user nova-compute[74788]:     <disk type="file" device="cdrom">
Nov 08 15:12:15 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 15:12:15 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config"/>
Nov 08 15:12:15 user nova-compute[74788]:       <target dev="hda" bus="ide"/>
Nov 08 15:12:15 user nova-compute[74788]:     </disk>
Nov 08 15:12:15 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:12:15 user nova-compute[74788]:       <mac address="fa:16:3e:3e:9d:5a"/>
Nov 08 15:12:15 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:15 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:12:15 user nova-compute[74788]:       <target dev="tap2d460349-ac"/>
Nov 08 15:12:15 user nova-compute[74788]:     </interface>
Nov 08 15:12:15 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:12:15 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log" append="off"/>
Nov 08 15:12:15 user nova-compute[74788]:     </serial>
Nov 08 15:12:15 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:12:15 user nova-compute[74788]:     <video>
Nov 08 15:12:15 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:15 user nova-compute[74788]:     </video>
Nov 08 15:12:15 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:12:15 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:12:15 user nova-compute[74788]:     </rng>
Nov 08 15:12:15 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:12:15 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:12:15 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:12:15 user nova-compute[74788]:     </memballoon>
Nov 08 15:12:15 user nova-compute[74788]:   </devices>
Nov 08 15:12:15 user nova-compute[74788]: </domain>
Nov 08 15:12:15 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG os_vif [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61a15b26-5e78-592e-b479-6ea973c90444', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d460349-ac, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d460349-ac, col_values=(('qos', UUID('991d132d-b86f-492a-9b07-c0042f83eb3f')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d460349-ac, col_values=(('external_ids', {'iface-id': '2d460349-ac8e-41df-a62f-9b36089aa51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9d:5a', 'vm-uuid': '9b540dd4-ac0f-41a2-941a-a7dd519d2922'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: INFO os_vif [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac')
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.255s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name hda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No VIF found with MAC fa:16:3e:3e:9d:5a, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:12:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Using config drive
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Creating config drive at /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpov5qs4ee {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk 1073741824" returned: 0 in 0.157s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpov5qs4ee" returned: 0 in 0.101s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Successfully created port: 077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:15 user nova-compute[74788]: WARNING nova.compute.manager [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state None.
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-changed-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing instance network info cache due to event network-changed-2d460349-ac8e-41df-a62f-9b36089aa51f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing network info cache for port 2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.272s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:12:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Cannot resize image /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Ensure instance console log exists: /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updated VIF entry in instance network info cache for port 2d460349-ac8e-41df-a62f-9b36089aa51f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17d3c8aa-de5c-4c02-84d9-14831bb1c12c req-18caf4e7-0d63-4298-b678-de91a9e87bff service nova] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Successfully updated port: 077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquired lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-changed-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Refreshing instance network info cache due to event network-changed-077f52bb-2fa5-4f82-a470-9171cfe4ec62. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] Acquiring lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating instance_info_cache with network_info: [{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Releasing lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Instance network_info: |[{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] Acquired lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Refreshing network info cache for port 077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Start _get_guest_xml network_info=[{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:12:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1231602173',display_name='tempest-TestVolumeSwap-server-1231602173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1231602173',id=6,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIwVXgoQbJw262vxx7TsEs6jSpyTWuiVure+sLlWGskQ73Si2G5B55x2s06skPF8bKJkadWNc4nViDhg0qpt0+4X6RzHVuBEdAD1NPbivBvIy4SpfIL7tc8xv7CMOvb4Q==',key_name='tempest-keypair-1106911753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1571ef1f543a4537a4d1c50d9aeaa5bc',ramdisk_id='',reservation_id='r-6x5lxhlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-878514580',owner_user_name='tempest-TestVolumeSwap-878514580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b172221dfe874ddc8635edb474d8c599',uuid=3e877b14-1461-4307-8bc9-363e1efaaa94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converting VIF {"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.objects.instance [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:12:17 user nova-compute[74788]:   <uuid>3e877b14-1461-4307-8bc9-363e1efaaa94</uuid>
Nov 08 15:12:17 user nova-compute[74788]:   <name>instance-00000006</name>
Nov 08 15:12:17 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:12:17 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:12:17 user nova-compute[74788]:   <metadata>
Nov 08 15:12:17 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:12:17 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:name>tempest-TestVolumeSwap-server-1231602173</nova:name>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:12:17</nova:creationTime>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:12:17 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:12:17 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:owner>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:user uuid="b172221dfe874ddc8635edb474d8c599">tempest-TestVolumeSwap-878514580-project-member</nova:user>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:project uuid="1571ef1f543a4537a4d1c50d9aeaa5bc">tempest-TestVolumeSwap-878514580</nova:project>
Nov 08 15:12:17 user nova-compute[74788]:       </nova:owner>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:12:17 user nova-compute[74788]:       <nova:ports>
Nov 08 15:12:17 user nova-compute[74788]:         <nova:port uuid="077f52bb-2fa5-4f82-a470-9171cfe4ec62">
Nov 08 15:12:17 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:12:17 user nova-compute[74788]:         </nova:port>
Nov 08 15:12:17 user nova-compute[74788]:       </nova:ports>
Nov 08 15:12:17 user nova-compute[74788]:     </nova:instance>
Nov 08 15:12:17 user nova-compute[74788]:   </metadata>
Nov 08 15:12:17 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:12:17 user nova-compute[74788]:     <system>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="serial">3e877b14-1461-4307-8bc9-363e1efaaa94</entry>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="uuid">3e877b14-1461-4307-8bc9-363e1efaaa94</entry>
Nov 08 15:12:17 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:12:17 user nova-compute[74788]:     </system>
Nov 08 15:12:17 user nova-compute[74788]:   </sysinfo>
Nov 08 15:12:17 user nova-compute[74788]:   <os>
Nov 08 15:12:17 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:12:17 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:12:17 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:12:17 user nova-compute[74788]:   </os>
Nov 08 15:12:17 user nova-compute[74788]:   <features>
Nov 08 15:12:17 user nova-compute[74788]:     <acpi/>
Nov 08 15:12:17 user nova-compute[74788]:     <apic/>
Nov 08 15:12:17 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:12:17 user nova-compute[74788]:   </features>
Nov 08 15:12:17 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:12:17 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:12:17 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:12:17 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:12:17 user nova-compute[74788]:   </clock>
Nov 08 15:12:17 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:12:17 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:12:17 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:12:17 user nova-compute[74788]:   </cpu>
Nov 08 15:12:17 user nova-compute[74788]:   <devices>
Nov 08 15:12:17 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:12:17 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:12:17 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk"/>
Nov 08 15:12:17 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:12:17 user nova-compute[74788]:     </disk>
Nov 08 15:12:17 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:12:17 user nova-compute[74788]:       <mac address="fa:16:3e:da:70:0f"/>
Nov 08 15:12:17 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:17 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:12:17 user nova-compute[74788]:       <target dev="tap077f52bb-2f"/>
Nov 08 15:12:17 user nova-compute[74788]:     </interface>
Nov 08 15:12:17 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:12:17 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/console.log" append="off"/>
Nov 08 15:12:17 user nova-compute[74788]:     </serial>
Nov 08 15:12:17 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:12:17 user nova-compute[74788]:     <video>
Nov 08 15:12:17 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:17 user nova-compute[74788]:     </video>
Nov 08 15:12:17 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:12:17 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:12:17 user nova-compute[74788]:     </rng>
Nov 08 15:12:17 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:12:17 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:12:17 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:12:17 user nova-compute[74788]:     </memballoon>
Nov 08 15:12:17 user nova-compute[74788]:   </devices>
Nov 08 15:12:17 user nova-compute[74788]: </domain>
Nov 08 15:12:17 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1231602173',display_name='tempest-TestVolumeSwap-server-1231602173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1231602173',id=6,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIwVXgoQbJw262vxx7TsEs6jSpyTWuiVure+sLlWGskQ73Si2G5B55x2s06skPF8bKJkadWNc4nViDhg0qpt0+4X6RzHVuBEdAD1NPbivBvIy4SpfIL7tc8xv7CMOvb4Q==',key_name='tempest-keypair-1106911753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1571ef1f543a4537a4d1c50d9aeaa5bc',ramdisk_id='',reservation_id='r-6x5lxhlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-878514580',owner_user_name='tempest-TestVolumeSwap-878514580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b172221dfe874ddc8635edb474d8c599',uuid=3e877b14-1461-4307-8bc9-363e1efaaa94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converting VIF {"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG os_vif [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7904c59-e8bc-5ffe-84c7-a84504fde9bb', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap077f52bb-2f, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap077f52bb-2f, col_values=(('qos', UUID('b7800e86-2d71-4003-865f-898f38219d28')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap077f52bb-2f, col_values=(('external_ids', {'iface-id': '077f52bb-2fa5-4f82-a470-9171cfe4ec62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:70:0f', 'vm-uuid': '3e877b14-1461-4307-8bc9-363e1efaaa94'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: INFO os_vif [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f')
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] No VIF found with MAC fa:16:3e:da:70:0f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updated VIF entry in instance network info cache for port 077f52bb-2fa5-4f82-a470-9171cfe4ec62. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating instance_info_cache with network_info: [{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-000b23b7-3c65-42cd-a3e3-21e4f2f369a9 req-6c25f3f9-0109-4e0b-b05c-7a16cccc6ebe service nova] Releasing lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:12:19 user nova-compute[74788]: INFO nova.compute.claims [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Claim successful on node user
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:12:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG nova.policy [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa0eb377065b49e195ffbb567e9f24d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac35e95502a46c698f5466e10607cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:12:20 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Creating image(s)
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "/opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "/opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk 1073741824" returned: 0 in 0.064s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Successfully created port: 7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:12:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Cannot resize image /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Ensure instance console log exists: /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] No waiting events found dispatching network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:21 user nova-compute[74788]: WARNING nova.compute.manager [req-4685c8a4-7c6e-4cda-855b-17964b0ded65 req-42f7504b-31ca-4b58-9d86-88bee9d15e6e service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received unexpected event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff for instance with vm_state active and task_state None.
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:12:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Instance spawned successfully.
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:21 user nova-compute[74788]: INFO nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Took 10.24 seconds to spawn the instance on the hypervisor.
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Successfully updated port: 7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquired lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:21 user nova-compute[74788]: INFO nova.compute.manager [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Took 11.71 seconds to build instance.
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-changed-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Refreshing instance network info cache due to event network-changed-7083d1ad-fe21-4bf4-9330-4c751f45ccc0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] Acquiring lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6462487c-0d02-4ae6-99d3-7f8c5aac40d4 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.844s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updating instance_info_cache with network_info: [{"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Releasing lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Instance network_info: |[{"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] Acquired lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Refreshing network info cache for port 7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Start _get_guest_xml network_info=[{"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:12:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Instance spawned successfully.
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-707679632',display_name='tempest-VolumesAssistedSnapshotsTest-server-707679632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-707679632',id=7,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZoZP5pEPETFrwHLJ2RKqNlGR+hAdJrc9mCY0p00StMxIP5yBPvLWLji9D1+k6rlLBap/Ypu8L8cOKvPvGwUHH9qKDFcqt4meUiUO1c84CAq9+Dq2FGp0EtMa7KJ3mDrA==',key_name='tempest-keypair-433980243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac35e95502a46c698f5466e10607cb3',ramdisk_id='',reservation_id='r-wxmvfkq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-808077194',owner_user_name='tempest-VolumesAssistedSnapshotsTest-808077194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0eb377065b49e195ffbb567e9f24d5',uuid=5e2c5895-77ac-4012-a746-183e8a9c841d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converting VIF {"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.objects.instance [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:12:22 user nova-compute[74788]:   <uuid>5e2c5895-77ac-4012-a746-183e8a9c841d</uuid>
Nov 08 15:12:22 user nova-compute[74788]:   <name>instance-00000007</name>
Nov 08 15:12:22 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:12:22 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:12:22 user nova-compute[74788]:   <metadata>
Nov 08 15:12:22 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:12:22 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-707679632</nova:name>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:12:22</nova:creationTime>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:12:22 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:12:22 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:owner>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:user uuid="fa0eb377065b49e195ffbb567e9f24d5">tempest-VolumesAssistedSnapshotsTest-808077194-project-member</nova:user>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:project uuid="5ac35e95502a46c698f5466e10607cb3">tempest-VolumesAssistedSnapshotsTest-808077194</nova:project>
Nov 08 15:12:22 user nova-compute[74788]:       </nova:owner>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:12:22 user nova-compute[74788]:       <nova:ports>
Nov 08 15:12:22 user nova-compute[74788]:         <nova:port uuid="7083d1ad-fe21-4bf4-9330-4c751f45ccc0">
Nov 08 15:12:22 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 15:12:22 user nova-compute[74788]:         </nova:port>
Nov 08 15:12:22 user nova-compute[74788]:       </nova:ports>
Nov 08 15:12:22 user nova-compute[74788]:     </nova:instance>
Nov 08 15:12:22 user nova-compute[74788]:   </metadata>
Nov 08 15:12:22 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:12:22 user nova-compute[74788]:     <system>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="serial">5e2c5895-77ac-4012-a746-183e8a9c841d</entry>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="uuid">5e2c5895-77ac-4012-a746-183e8a9c841d</entry>
Nov 08 15:12:22 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:12:22 user nova-compute[74788]:     </system>
Nov 08 15:12:22 user nova-compute[74788]:   </sysinfo>
Nov 08 15:12:22 user nova-compute[74788]:   <os>
Nov 08 15:12:22 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:12:22 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:12:22 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:12:22 user nova-compute[74788]:   </os>
Nov 08 15:12:22 user nova-compute[74788]:   <features>
Nov 08 15:12:22 user nova-compute[74788]:     <acpi/>
Nov 08 15:12:22 user nova-compute[74788]:     <apic/>
Nov 08 15:12:22 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:12:22 user nova-compute[74788]:   </features>
Nov 08 15:12:22 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:12:22 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:12:22 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:12:22 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:12:22 user nova-compute[74788]:   </clock>
Nov 08 15:12:22 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:12:22 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:12:22 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:12:22 user nova-compute[74788]:   </cpu>
Nov 08 15:12:22 user nova-compute[74788]:   <devices>
Nov 08 15:12:22 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:12:22 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:12:22 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk"/>
Nov 08 15:12:22 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:12:22 user nova-compute[74788]:     </disk>
Nov 08 15:12:22 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:12:22 user nova-compute[74788]:       <mac address="fa:16:3e:a9:71:76"/>
Nov 08 15:12:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:22 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:12:22 user nova-compute[74788]:       <target dev="tap7083d1ad-fe"/>
Nov 08 15:12:22 user nova-compute[74788]:     </interface>
Nov 08 15:12:22 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:12:22 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/console.log" append="off"/>
Nov 08 15:12:22 user nova-compute[74788]:     </serial>
Nov 08 15:12:22 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:12:22 user nova-compute[74788]:     <video>
Nov 08 15:12:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:12:22 user nova-compute[74788]:     </video>
Nov 08 15:12:22 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:12:22 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:12:22 user nova-compute[74788]:     </rng>
Nov 08 15:12:22 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:12:22 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:12:22 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:12:22 user nova-compute[74788]:     </memballoon>
Nov 08 15:12:22 user nova-compute[74788]:   </devices>
Nov 08 15:12:22 user nova-compute[74788]: </domain>
Nov 08 15:12:22 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-707679632',display_name='tempest-VolumesAssistedSnapshotsTest-server-707679632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-707679632',id=7,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZoZP5pEPETFrwHLJ2RKqNlGR+hAdJrc9mCY0p00StMxIP5yBPvLWLji9D1+k6rlLBap/Ypu8L8cOKvPvGwUHH9qKDFcqt4meUiUO1c84CAq9+Dq2FGp0EtMa7KJ3mDrA==',key_name='tempest-keypair-433980243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac35e95502a46c698f5466e10607cb3',ramdisk_id='',reservation_id='r-wxmvfkq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-808077194',owner_user_name='tempest-VolumesAssistedSnapshotsTest-808077194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0eb377065b49e195ffbb567e9f24d5',uuid=5e2c5895-77ac-4012-a746-183e8a9c841d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converting VIF {"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG os_vif [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] No waiting events found dispatching network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:22 user nova-compute[74788]: WARNING nova.compute.manager [req-054121fb-049d-4ae4-a946-9f99ebdc9d2f req-ab6dd801-bac5-440e-b0e3-44221f143273 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received unexpected event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 for instance with vm_state building and task_state spawning.
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed62c38f-bf60-5881-a218-23ea18c96d56', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7083d1ad-fe, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7083d1ad-fe, col_values=(('qos', UUID('b0cc335f-d664-422d-97ed-71c1058a9a8d')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7083d1ad-fe, col_values=(('external_ids', {'iface-id': '7083d1ad-fe21-4bf4-9330-4c751f45ccc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:71:76', 'vm-uuid': '5e2c5895-77ac-4012-a746-183e8a9c841d'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:22 user nova-compute[74788]: INFO os_vif [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe')
Nov 08 15:12:22 user nova-compute[74788]: INFO nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] No VIF found with MAC fa:16:3e:a9:71:76, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:12:22 user nova-compute[74788]: INFO nova.compute.manager [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Took 8.33 seconds to build instance.
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48644015-27dd-47cb-86ae-5b687b8ecf3e tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.517s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updated VIF entry in instance network info cache for port 7083d1ad-fe21-4bf4-9330-4c751f45ccc0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updating instance_info_cache with network_info: [{"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ecbf879-8539-4ced-a632-f1742a0063e0 req-2acbbb14-e226-4788-afa6-d56aa4ee9666 service nova] Releasing lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] No waiting events found dispatching network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:23 user nova-compute[74788]: WARNING nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received unexpected event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff for instance with vm_state active and task_state None.
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:23 user nova-compute[74788]: WARNING nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f for instance with vm_state active and task_state None.
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:23 user nova-compute[74788]: WARNING nova.compute.manager [req-b0a1b825-5300-4614-9924-6914bae2501c req-6c1d9d1c-f247-4d62-9163-d0103009203a service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f for instance with vm_state active and task_state None.
Nov 08 15:12:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG nova.compute.manager [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG nova.compute.manager [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] No waiting events found dispatching network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:24 user nova-compute[74788]: WARNING nova.compute.manager [req-a2590559-2456-4fa2-ba82-bdfeb4606e84 req-a653d746-87ae-49b0-b94b-3bd9cf1a1572 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received unexpected event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 for instance with vm_state active and task_state None.
Nov 08 15:12:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:25 user nova-compute[74788]: WARNING nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state building and task_state spawning.
Nov 08 15:12:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:12:25 user nova-compute[74788]: WARNING nova.compute.manager [req-d7055d0b-2210-4a4f-a517-a06e55cf8d4d req-9bfe1275-8583-4f7d-b8c9-130663ed75de service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state building and task_state spawning.
Nov 08 15:12:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:12:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Instance spawned successfully.
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:12:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:27 user nova-compute[74788]: INFO nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 08 15:12:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:12:27 user nova-compute[74788]: INFO nova.compute.manager [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Took 8.36 seconds to build instance.
Nov 08 15:12:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-64127ad4-030f-4293-abae-1657037f69ab tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.519s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:28 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:12:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.81256103515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 5e2c5895-77ac-4012-a746-183e8a9c841d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:12:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:12:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.971s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:12:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:12:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:12:48 user nova-compute[74788]: INFO nova.compute.claims [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Claim successful on node user
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:12:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:12:49 user nova-compute[74788]: INFO nova.virt.block_device [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Booting with volume 2b5251fd-3275-45d8-994c-180882761901 at /dev/vda
Nov 08 15:12:49 user nova-compute[74788]: DEBUG nova.policy [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc01abecef094ba7a60598071aef302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd9e29971b9494cae915e79db86fa47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:12:49 user nova-compute[74788]: DEBUG os_brick.utils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:12:49 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5s4ov8jk/privsep.sock']
Nov 08 15:12:49 user sudo[85481]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5s4ov8jk/privsep.sock
Nov 08 15:12:49 user sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 15:12:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Successfully created port: aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:12:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Successfully updated port: aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:12:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquired lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-changed-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Refreshing instance network info cache due to event network-changed-aba69107-b8dd-4250-b080-574b0a47c91f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] Acquiring lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:12:51 user sudo[85481]: pam_unix(sudo:session): session closed for user root
Nov 08 15:12:51 user nova-compute[74788]: INFO oslo.privsep.daemon [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Spawned new privsep daemon via rootwrap
Nov 08 15:12:51 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 15:12:51 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 15:12:51 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 15:12:51 user nova-compute[74788]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85485
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd85e3b-2f13-444b-ad51-a9e00917e544]: (2,) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating instance_info_cache with network_info: [{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Releasing lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance network_info: |[{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] Acquired lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Refreshing network info cache for port aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3f8661-015b-4696-9cdd-026c2c5e505a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: WARNING os_brick.initiator.connectors.nvmeof [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dea447-9fee-4be2-bd8d-aa852e773d12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5b4355-e404-41e1-85cb-52fbe281a781]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a8da4-07b3-489e-b300-fee11680d8fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:12:51 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa9518-17ce-4063-9677-f42d7e551fa8]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG os_brick.utils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== get_connector_properties: return (1911ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating existing volume attachment record: d5a5b53f-e190-44b2-8827-a289bccd8543 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updated VIF entry in instance network info cache for port aba69107-b8dd-4250-b080-574b0a47c91f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating instance_info_cache with network_info: [{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1836b10e-8583-4e0d-9592-033764c18668 req-dd17bb6f-0c0e-4e03-97f0-40e9288ab68e service nova] Releasing lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:12:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:12:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:13:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:13:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:13:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Creating image(s)
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start _get_guest_xml network_info=[{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8defda1b-5de4-4d07-8d5c-8fd1b26333b5', 'attached_at': '', 'detached_at': '', 'volume_id': '2b5251fd-3275-45d8-994c-180882761901', 'serial': '2b5251fd-3275-45d8-994c-180882761901'}, 'attachment_id': 'd5a5b53f-e190-44b2-8827-a289bccd8543', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:13:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:13:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:13:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connector [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Factory for ISCSI on None {{(pid=74788) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:13:15 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:13:15 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:13:15 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cfd2a3-ea9e-407b-8183-ce186a8114e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:13:15 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c43235-288f-4d22-a2d4-04b3b293c8fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901] added
Nov 08 15:13:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638bf3c-a28a-45ff-a14b-b6b19ca435a1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ecde56-8d5c-4ebf-97b5-c07e667afc6b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvKUlEFp {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvKUlEFp" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddec436-aeae-4945-993e-44ab20b95e22]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvKUlEFp'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8f791-7b54-477a-98de-de0e5fd73ae7]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b11fcdd-3be8-4167-b045-61d59f1b953e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:13:15 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:13:15 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:13:15 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:13:15 user nova-compute[74788]: 
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[912df905-380f-4198-90a8-92c94cc96cad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]
Nov 08 15:13:15 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.
Nov 08 15:13:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a478218f-267b-4286-ad1f-aeb5c942efda]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc45c7b-fbe8-46fd-8b72-7a8949034753]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:13:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:13:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3a958-b661-427d-839a-b54f9f59ddd0]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26333656438383939', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333656438383939', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1566444936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.objects.instance [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lazy-loading 'pci_devices' on Instance uuid 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:13:16 user nova-compute[74788]:   <uuid>8defda1b-5de4-4d07-8d5c-8fd1b26333b5</uuid>
Nov 08 15:13:16 user nova-compute[74788]:   <name>instance-00000008</name>
Nov 08 15:13:16 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:13:16 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:13:16 user nova-compute[74788]:   <metadata>
Nov 08 15:13:16 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:13:16 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:13:16 user nova-compute[74788]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1566444936</nova:name>
Nov 08 15:13:16 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:13:14</nova:creationTime>
Nov 08 15:13:16 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:13:16 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:13:16 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:13:16 user nova-compute[74788]:       <nova:owner>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:user uuid="fc01abecef094ba7a60598071aef302d">tempest-ServerActionsV293TestJSON-1497590387-project-member</nova:user>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:project uuid="dbd9e29971b9494cae915e79db86fa47">tempest-ServerActionsV293TestJSON-1497590387</nova:project>
Nov 08 15:13:16 user nova-compute[74788]:       </nova:owner>
Nov 08 15:13:16 user nova-compute[74788]:       <nova:ports>
Nov 08 15:13:16 user nova-compute[74788]:         <nova:port uuid="aba69107-b8dd-4250-b080-574b0a47c91f">
Nov 08 15:13:16 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:13:16 user nova-compute[74788]:         </nova:port>
Nov 08 15:13:16 user nova-compute[74788]:       </nova:ports>
Nov 08 15:13:16 user nova-compute[74788]:     </nova:instance>
Nov 08 15:13:16 user nova-compute[74788]:   </metadata>
Nov 08 15:13:16 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:13:16 user nova-compute[74788]:     <system>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="serial">8defda1b-5de4-4d07-8d5c-8fd1b26333b5</entry>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="uuid">8defda1b-5de4-4d07-8d5c-8fd1b26333b5</entry>
Nov 08 15:13:16 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:13:16 user nova-compute[74788]:     </system>
Nov 08 15:13:16 user nova-compute[74788]:   </sysinfo>
Nov 08 15:13:16 user nova-compute[74788]:   <os>
Nov 08 15:13:16 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:13:16 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:13:16 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:13:16 user nova-compute[74788]:   </os>
Nov 08 15:13:16 user nova-compute[74788]:   <features>
Nov 08 15:13:16 user nova-compute[74788]:     <acpi/>
Nov 08 15:13:16 user nova-compute[74788]:     <apic/>
Nov 08 15:13:16 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:13:16 user nova-compute[74788]:   </features>
Nov 08 15:13:16 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:13:16 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:13:16 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:13:16 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:13:16 user nova-compute[74788]:   </clock>
Nov 08 15:13:16 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:13:16 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:13:16 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:13:16 user nova-compute[74788]:   </cpu>
Nov 08 15:13:16 user nova-compute[74788]:   <devices>
Nov 08 15:13:16 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:13:16 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:13:16 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:13:16 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:13:16 user nova-compute[74788]:       <serial>2b5251fd-3275-45d8-994c-180882761901</serial>
Nov 08 15:13:16 user nova-compute[74788]:     </disk>
Nov 08 15:13:16 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:13:16 user nova-compute[74788]:       <mac address="fa:16:3e:e4:13:36"/>
Nov 08 15:13:16 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:13:16 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:13:16 user nova-compute[74788]:       <target dev="tapaba69107-b8"/>
Nov 08 15:13:16 user nova-compute[74788]:     </interface>
Nov 08 15:13:16 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:13:16 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5/console.log" append="off"/>
Nov 08 15:13:16 user nova-compute[74788]:     </serial>
Nov 08 15:13:16 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:13:16 user nova-compute[74788]:     <video>
Nov 08 15:13:16 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:13:16 user nova-compute[74788]:     </video>
Nov 08 15:13:16 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:13:16 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:13:16 user nova-compute[74788]:     </rng>
Nov 08 15:13:16 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:13:16 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:13:16 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:13:16 user nova-compute[74788]:     </memballoon>
Nov 08 15:13:16 user nova-compute[74788]:   </devices>
Nov 08 15:13:16 user nova-compute[74788]: </domain>
Nov 08 15:13:16 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1566444936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG os_vif [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '471bcdbe-3515-55f3-835f-2fd19da4ce15', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaba69107-b8, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaba69107-b8, col_values=(('qos', UUID('7e0c6393-209c-4fea-8175-33b4be67e2ad')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaba69107-b8, col_values=(('external_ids', {'iface-id': 'aba69107-b8dd-4250-b080-574b0a47c91f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:13:36', 'vm-uuid': '8defda1b-5de4-4d07-8d5c-8fd1b26333b5'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:16 user nova-compute[74788]: INFO os_vif [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8')
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:13:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] No VIF found with MAC fa:16:3e:e4:13:36, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:13:17 user nova-compute[74788]: WARNING nova.compute.manager [req-a885e594-7964-4758-8241-703007e26a91 req-ac924e76-2a70-401f-aa31-3dea589f47f0 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state building and task_state spawning.
Nov 08 15:13:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:13:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:13:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance spawned successfully.
Nov 08 15:13:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:13:20 user nova-compute[74788]: WARNING nova.compute.manager [req-3f055c6e-5f09-498c-9b0e-0e3003847bd2 req-a98a3ec2-4a74-469c-bca1-255209264d8f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state building and task_state spawning.
Nov 08 15:13:20 user nova-compute[74788]: INFO nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 08 15:13:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:13:20 user nova-compute[74788]: INFO nova.compute.manager [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Took 31.28 seconds to build instance.
Nov 08 15:13:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-80fb2c8a-8662-44a2-b02d-09f988d0da4d tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.399s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:13:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:13:29 user nova-compute[74788]: INFO nova.compute.claims [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Claim successful on node user
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:13:29 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:13:29 user nova-compute[74788]: INFO nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Booting with volume 0c500d05-0bfc-42e7-9c57-0507d9e4ece4 at /dev/vda
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.policy [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3908028027ad4e5c9dc89c44c467538e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab888621e1234bd480d99e82e1725ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[03acdf4d-6436-4588-bb1a-d5cf9e4eabd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e43b79-6f62-4f84-9d94-b88f41bf796a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d9e9a-70bc-4514-a278-0bb69ebdb001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8874f521-d922-46bd-8088-274c7a990ecc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:29 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450821a-18dc-42ba-baec-ba5de1b4073e]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating existing volume attachment record: 2bed1bf3-7c51-4ef8-bf7c-050def6e7967 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:29 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully created port: 487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully created port: e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully created port: 278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-changed-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Refreshing instance network info cache due to event network-changed-210c398c-b530-47f9-9e1b-e8d1b41f6389. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG nova.network.neutron [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Refreshing network info cache for port 210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully created port: ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully created port: 8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG nova.network.neutron [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updated VIF entry in instance network info cache for port 210c398c-b530-47f9-9e1b-e8d1b41f6389. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG nova.network.neutron [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:13:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:13:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7522MB free_disk=25.69473648071289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8e0be0ba-537a-4c65-b91f-0efd14f0e981 req-fe57f80d-f625-46ea-bb10-ef68087b254b service nova] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 5e2c5895-77ac-4012-a746-183e8a9c841d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: 487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port 487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bec8f6b-bd84-4e09-9d29-5d9de5b4897f req-6a852eb5-19f3-4435-81ef-e515788cee84 service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: 15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port 15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-e45635a9-2ce7-43c2-aad5-bb088282bfdf. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: 278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-changed-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Refreshing instance network info cache due to event network-changed-64118033-36fd-4778-a574-53d4a32ec9c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Refreshing network info cache for port 64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e638248c-97b7-4f9a-a345-d96460059984 req-d4aba9bb-9540-4c25-bc24-6e406c998e8f service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Successfully updated port: 8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-e2527fe3-33e1-4798-8e1a-71f05e294af9. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updated VIF entry in instance network info cache for port 64118033-36fd-4778-a574-53d4a32ec9c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf0fb9b3-8d0d-438f-aef1-13fae97b5b0c req-6fc83fac-198c-4be4-8448-4f42b82c59c6 service nova] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:38 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-8fe5c07a-db64-46d0-92d1-789fe668bfb7. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance network_info: |[{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updated VIF entry in instance network info cache for port e2527fe3-33e1-4798-8e1a-71f05e294af9. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-278b75c7-5eb7-4720-b102-da322c43d942. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port 278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updated VIF entry in instance network info cache for port 278b75c7-5eb7-4720-b102-da322c43d942. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-ea7473f4-3974-4b51-ba35-01c2b5bbb63d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updated VIF entry in instance network info cache for port ea7473f4-3974-4b51-ba35-01c2b5bbb63d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a8c4f6d-23fa-4513-befc-d46681b875a9 req-72a7d465-064f-47ee-881c-41046044e16d service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port 8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:13:42 user nova-compute[74788]: INFO nova.compute.claims [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Claim successful on node user
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updated VIF entry in instance network info cache for port 8fe5c07a-db64-46d0-92d1-789fe668bfb7. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9617d05-d793-4a29-ab0e-d84fa92db147 req-62c299b7-3fb5-4651-9735-4c1482c720f9 service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:13:43 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:13:43 user nova-compute[74788]: INFO nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Booting with volume fb450b81-c61c-4b4f-be45-59cbfd0760cc at /dev/vda
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.policy [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d79cdc433984f32b193b6334732d5f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '267e279227b64367abe0b6f3d039de11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e824f2e-d805-4792-a7be-1f564477080b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e7a6e-71eb-44c0-9a25-9f1ff3d20786]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647eefe-16ab-4b87-a2dc-58d0484e6347]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e3618-7d75-4ab0-8fab-2e9a652991e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:43 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:13:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[832eebae-5ef1-49e4-bbb7-bebf97f3fc02]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:13:43 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating existing volume attachment record: 25a5bf5b-e614-4129-89f1-b5e1037e58c4 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully created port: dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-changed-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Refreshing instance network info cache due to event network-changed-95b82f6a-a3fb-471e-9806-04a5dd098e47. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] Acquiring lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] Acquired lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Refreshing network info cache for port 95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:13:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG nova.network.neutron [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updated VIF entry in instance network info cache for port 95b82f6a-a3fb-471e-9806-04a5dd098e47. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG nova.network.neutron [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating instance_info_cache with network_info: [{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-41e0a2a2-6d9b-4719-b43c-a79dcfbc63dd req-780aaa93-30ae-4604-a56f-78042e0cdadf service nova] Releasing lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully created port: 1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:13:45 user nova-compute[74788]: INFO nova.compute.manager [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Attaching volume 2d247311-d76c-4f7f-8cfe-858866681f85 to /dev/vdb
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.utils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d132e-4f58-4edd-96cd-6ef6258fe30d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[999af31f-124a-4d01-a47b-278472ca6864]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8013122-8c0a-4c2c-bd1d-8aabfdf372b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf85cb94-18c9-46bc-a5bf-e9cdf966efaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:13:45 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:13:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e515c2d1-36a9-49ce-a10a-85eb8e69ba34]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG os_brick.utils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:13:45 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating existing volume attachment record: c4e6c571-9ed3-4de6-8de2-2768f62a4a15 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:13:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully created port: c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully created port: 7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully created port: d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:13:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3e29df1f-4112-4ae1-920c-8c93fece95df req-daab427f-97a6-4a1c-a92e-133e6b84acf1 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-fcd5386a-a476-4bb0-a6a3-f88c500b3b89. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d268933e-d9b3-413b-8989-53e838f8c001 req-467473f6-2d75-4687-aa8e-d3eff4b69f07 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: 1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-1807f7bc-d09c-457b-9da0-eba51c82ae67. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port 1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: 7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-c2ebf52e-0769-424d-bd4f-721dda443697. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dac79dcf-4753-4521-9a7d-4089cd2ac111 req-dd80ab55-f477-407b-b78a-7d00f5583b08 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Successfully updated port: d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:13:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:13:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:13:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-7f03eb0d-2b92-418a-9630-5c836354c0fe. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:55 user nova-compute[74788]: DEBUG nova.network.neutron [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance network_info: |[{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:13:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:55 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port 7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-changed-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Refreshing instance network info cache due to event network-changed-d62b0b42-b510-4a5d-ba8e-f126417897ff. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] Acquiring lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] Acquired lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Refreshing network info cache for port d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updated VIF entry in instance network info cache for port d62b0b42-b510-4a5d-ba8e-f126417897ff. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19399522-5289-49ad-b4f8-9f2c97be8197 req-5b800ac9-00cd-4bba-a7d1-9f52722def80 service nova] Releasing lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updated VIF entry in instance network info cache for port 7f03eb0d-2b92-418a-9630-5c836354c0fe. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-d2e7e46b-b063-4391-88f0-cb90487c6f92. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:13:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:13:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:13:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updated VIF entry in instance network info cache for port d2e7e46b-b063-4391-88f0-cb90487c6f92. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:13:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:13:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613dd149-0180-4699-b13d-2bb847c4bfbe req-457f4748-64e5-4203-a6f7-f6d76c8b0b0b service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-changed-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing instance network info cache due to event network-changed-2d460349-ac8e-41df-a62f-9b36089aa51f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:14:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing network info cache for port 2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updated VIF entry in instance network info cache for port 2d460349-ac8e-41df-a62f-9b36089aa51f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e41d2726-3661-4c3a-b385-15dbd3a56979 req-6512fd55-46c5-495f-8c04-c74b38cfd319 service nova] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'pci_requests' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Object Instance<9b540dd4-ac0f-41a2-941a-a7dd519d2922> lazy-loaded attributes: flavor,pci_requests {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:01 user nova-compute[74788]: DEBUG nova.policy [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649cb7a8623d4a70933af2e4742921ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0a360ac3974426b6f6aea8e48dcfb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:14:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Successfully created port: ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Successfully updated port: ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-changed-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing instance network info cache due to event network-changed-ddb63fbc-0493-4e78-9191-a897435bfabb. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.neutron [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Refreshing network info cache for port ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG os_vif [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '695c71b3-0c34-5d8c-869c-ed6fa941daf0', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddb63fbc-04, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddb63fbc-04, col_values=(('qos', UUID('8435bf7c-6e77-4b96-9a3e-c1c757ecaf1d')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddb63fbc-04, col_values=(('external_ids', {'iface-id': 'ddb63fbc-0493-4e78-9191-a897435bfabb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:c0:46', 'vm-uuid': '9b540dd4-ac0f-41a2-941a-a7dd519d2922'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: INFO os_vif [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04')
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] attach device xml: <interface type="ethernet">
Nov 08 15:14:03 user nova-compute[74788]:   <mac address="fa:16:3e:ce:c0:46"/>
Nov 08 15:14:03 user nova-compute[74788]:   <model type="virtio"/>
Nov 08 15:14:03 user nova-compute[74788]:   <mtu size="1442"/>
Nov 08 15:14:03 user nova-compute[74788]:   <target dev="tapddb63fbc-04"/>
Nov 08 15:14:03 user nova-compute[74788]: </interface>
Nov 08 15:14:03 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:14:04 user nova-compute[74788]: WARNING nova.compute.manager [req-09264219-97b6-47d2-859f-a76b77b09b08 req-55754c95-2109-4298-965f-40a7b62a7a49 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb for instance with vm_state active and task_state None.
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.network.neutron [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updated VIF entry in instance network info cache for port ddb63fbc-0493-4e78-9191-a897435bfabb. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.network.neutron [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name hda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No VIF found with MAC fa:16:3e:3e:9d:5a, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3833875c-866b-4b20-8917-a0bf5fa5fed5 req-18db93a3-1535-4afc-bb60-a0f952bbeddc service nova] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:14:04 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:14:04</nova:creationTime>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:14:04 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:14:04 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:owner>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:14:04 user nova-compute[74788]:   </nova:owner>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:14:04 user nova-compute[74788]:   <nova:ports>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:14:04 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:14:04 user nova-compute[74788]:     </nova:port>
Nov 08 15:14:04 user nova-compute[74788]:     <nova:port uuid="ddb63fbc-0493-4e78-9191-a897435bfabb">
Nov 08 15:14:04 user nova-compute[74788]:       <nova:ip type="fixed" address="10.10.10.252" ipVersion="4"/>
Nov 08 15:14:04 user nova-compute[74788]:     </nova:port>
Nov 08 15:14:04 user nova-compute[74788]:   </nova:ports>
Nov 08 15:14:04 user nova-compute[74788]: </nova:instance>
Nov 08 15:14:04 user nova-compute[74788]:  {{(pid=74788) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ded1052c-d37e-4bc0-9b09-5defd1759ba1 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.143s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-changed-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Refreshing instance network info cache due to event network-changed-077f52bb-2fa5-4f82-a470-9171cfe4ec62. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:14:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] Acquiring lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] Acquired lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:05 user nova-compute[74788]: DEBUG nova.network.neutron [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Refreshing network info cache for port 077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:14:06 user nova-compute[74788]: WARNING nova.compute.manager [req-b04def00-31d3-4a5d-b458-fe66ee8ddf40 req-eff76b4d-09b0-463b-b4ef-f4f94e549627 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb for instance with vm_state active and task_state None.
Nov 08 15:14:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updated VIF entry in instance network info cache for port 077f52bb-2fa5-4f82-a470-9171cfe4ec62. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating instance_info_cache with network_info: [{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8157d64a-d549-4176-a49e-7a4ef514ecf1 req-e9b02d5b-19db-4577-a46a-9157a42ab34d service nova] Releasing lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lazy-loading 'flavor' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:09 user nova-compute[74788]: INFO nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Booting with volume 589db95a-8e57-45ef-9d18-91ea223c4788 at /dev/vdb
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'flavor' on Instance uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: INFO nova.compute.manager [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Attaching volume cdc5f952-33ee-4d95-b13c-aad482853144 to /dev/vdb
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[939360e1-b976-484d-b884-73dd1119c127]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af9f7b-d48d-4d9c-9cbd-4ca5e170179e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a728a6-24c9-44cf-9fa0-be49c4e2bf09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b60148-ba40-4f57-8f69-3b04efebbd56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:09 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff33003-41e9-441e-8ba7-ad6a7a45fea6]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating existing volume attachment record: 2fc70326-081c-416a-aa17-728754a30c6a {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: INFO nova.compute.manager [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attaching volume e75ebf1b-dff4-4520-83b3-0316ba582fa3 to /dev/vdb
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:09 user nova-compute[74788]: INFO nova.compute.manager [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Attaching volume 7854dd9d-a857-4e28-9e2a-b8df26f30479 to /dev/vdb
Nov 08 15:14:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-changed-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Refreshing instance network info cache due to event network-changed-7083d1ad-fe21-4bf4-9330-4c751f45ccc0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:14:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] Acquiring lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] Acquired lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Refreshing network info cache for port 7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG nova.network.neutron [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updated VIF entry in instance network info cache for port 7083d1ad-fe21-4bf4-9330-4c751f45ccc0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG nova.network.neutron [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updating instance_info_cache with network_info: [{"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b3ddf52d-47a0-4713-bb78-2d2de18c1c97 req-e2020c78-7a08-4da1-bda2-2f93bb250aba service nova] Releasing lock "refresh_cache-5e2c5895-77ac-4012-a746-183e8a9c841d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:11 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:11 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:11 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4317015-44b5-433c-a970-1f2f99a2f146]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:14:11 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff445294-852a-4d62-a7c6-271b0e55a2ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85] added
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c0239-4c3d-48ff-87f5-4c87370b3fc1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269647d-5932-42b4-bd18-5084c5598927]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HplrVbMq {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HplrVbMq" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3eab5-c98d-47af-9d93-d30537302877]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HplrVbMq'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.utils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac457f3c-6887-4c1a-b1b9-720f92ad7a5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7a5890-ee93-471f-bd6b-19d2531f984e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26dc776-034d-41d9-ae69-3c6471f565f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba40042-76cf-4453-b709-e4af78917832]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[72614b96-1f3d-461f-97a4-4927b41f0858]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da5e035-a96d-4f27-bd3d-19c652d7a38f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf1d96-ce25-46ba-896d-916cb64437a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]
Nov 08 15:14:11 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:11 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae177afb-a09c-4fb1-9a0f-db27f6ac1cbc]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.utils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating existing volume attachment record: 2f9a342b-dea7-4796-8519-46dea05b182e {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34a551b-02c6-4fd3-b257-e7d73e4e8144]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd62a5b-9512-4be3-a28f-69ac9d553c02]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115e65c-d867-4990-9af0-5ab27a8bde11]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG nova.objects.instance [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lazy-loading 'flavor' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.utils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23516a18-94f5-4ee8-b660-9ddf6038e48f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd7f65-2973-4ce0-8d57-62e73be8590b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48dde98-769e-4eec-b82a-b24418e7118f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.utils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac89c8-c858-4eed-9c71-ab81a05ebe02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a13faa-b163-44d1-9b45-26eaa3da23bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26639197-aac4-4edd-a722-8673446551b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:12 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e98370-a7ef-4c59-9cf8-9ace4e1be12e]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.utils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating existing volume attachment record: 02117278-8464-46b7-9c1c-3ea18c7768ff {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d2bc71-e325-46af-96a4-b0459df03c38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de26840-2f7a-4369-a99d-7c6839556a0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:12 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1564d806-8ed2-4c58-85d2-66082b3d96f9]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.utils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating existing volume attachment record: b4d3d563-c04c-4bc2-9d16-89e6549a203f {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26539356432393364', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539356432393364', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:14:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:14:12 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:14:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:14:12 user nova-compute[74788]:   <serial>2d247311-d76c-4f7f-8cfe-858866681f85</serial>
Nov 08 15:14:12 user nova-compute[74788]: </disk>
Nov 08 15:14:12 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:14:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No VIF found with MAC fa:16:3e:35:3e:45, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:14:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating instance_info_cache with network_info: [{"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-966892ee-94c8-442e-911d-54941e0efdbd" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:14:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:29 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:14:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:14:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=25.682086944580078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 5e2c5895-77ac-4012-a746-183e8a9c841d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance a3eb0aa7-8425-466e-b5e8-20186e80121e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:14:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSUbFlCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:35 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:35 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:35 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:14:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c1fca-430b-411f-933f-9e290c458c24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:14:35 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bfb6f0-58af-43a1-a502-2d366df368f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144] added
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdef30d-842e-4835-9b55-0bcd419a8f94]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[60674c0c-d1f4-462e-b8a3-5786bfd0172b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSUbFlCa {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NSUbFlCa" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f11ea3-2f26-46c8-814c-431a58805b21]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NSUbFlCa'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b831b-b58a-4d5b-9b9e-8b63bada2136]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b19e7e-0f7b-4539-918a-9bfb83353153]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f8bd0e-09fd-40fe-bea3-11a7d867b886]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260]
Nov 08 15:14:36 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260] successful.
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dcd762-f759-4136-bc20-c85211b6758d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd191ed9-36aa-4d84-9789-97b618794134]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:36 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2f0e0-2d88-41f8-a084-2abacbf4ecb4]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSUbFlCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e7e86c76-5e42-4ce1-99ac-65d201d84616 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.710s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:36 user nova-compute[74788]: INFO nova.compute.manager [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Attaching volume 34729c44-42d1-4ca8-8d93-c5ca877831b5 to /dev/vdb
Nov 08 15:14:36 user nova-compute[74788]: INFO nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Booting with volume 55d3fdfe-f44b-4e17-8475-e195b5312b3b at /dev/vdb
Nov 08 15:14:36 user nova-compute[74788]: INFO nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Booting with volume b8d672ae-d8b1-4e47-af05-b239aa6dd181 at /dev/vdc
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lazy-loading 'flavor' on Instance uuid 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.utils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5fa283-bed7-423b-a339-ad1346683b3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a806e3b4-a24d-4a41-a325-801e727ed6c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409e8c9-8c1e-4b2a-a6ed-ac4dffc1f2d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cf8c27-bae6-446d-b0a4-83d2941da5ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[def82bd1-ac52-4f92-b11d-94b4639cd420]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5c9070-fece-4aef-ba95-34ca4639a24b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb931d6-fb4e-48aa-a9ff-50bfbe721066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:37 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[609bc2a5-c7fc-4328-a8fe-7ad8ce36f7d3]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.utils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updating existing volume attachment record: ec6c93f3-d94e-43cf-a565-1fa07fbb26c7 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc4b24-4471-4ef3-bf37-9b58fae49385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831808e-11a5-45fb-a436-e28cafe899d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:37 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b623cefb-eb01-4e57-b477-efc0fce63fb3]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b29160-5f8d-4836-b7e3-35e99f542dc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating existing volume attachment record: 956d83af-1280-4dd0-a823-3d19887e036a {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce537dc1-bf7d-4d39-a306-09bf28968a62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5495950-c4a6-47cc-8d56-9c6383cb95d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:14:37 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22a6717-b85a-4d53-b24d-3f13158deb51]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.utils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating existing volume attachment record: 8ecb62a9-f918-43fe-9b50-1ca08d157486 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:14:37 user nova-compute[74788]: INFO nova.compute.manager [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Attaching volume e7bc6599-e893-4c4b-8d95-c8a5073abacd to /dev/sdc
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26338656338333264', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338656338333264', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:14:37 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:14:37 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:14:37 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:14:37 user nova-compute[74788]:   <serial>cdc5f952-33ee-4d95-b13c-aad482853144</serial>
Nov 08 15:14:37 user nova-compute[74788]: </disk>
Nov 08 15:14:37 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No BDM found with device name hda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] No VIF found with MAC fa:16:3e:3e:9d:5a, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:14:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-changed-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:14:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Refreshing instance network info cache due to event network-changed-aba69107-b8dd-4250-b080-574b0a47c91f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:14:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] Acquiring lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:14:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] Acquired lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:14:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Refreshing network info cache for port aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:14:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updated VIF entry in instance network info cache for port aba69107-b8dd-4250-b080-574b0a47c91f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:14:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating instance_info_cache with network_info: [{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:14:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0266b59c-9157-40d1-bab0-f19cb4ff2e67 req-9d05b464-52e2-498a-a5ad-aa1be88e6765 service nova] Releasing lock "refresh_cache-8defda1b-5de4-4d07-8d5c-8fd1b26333b5" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:14:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:14:55 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:55 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:14:55 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f9194-b82b-4652-919e-1705a52e20f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:14:55 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb018e-1b86-49c7-81a6-12a9e46be45e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3] added
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db7c3f7-61af-4fa0-a7f1-07fd2a3a275f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76fa246-0b3f-4834-9069-e2e4663133e7]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpOcAgvn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpOcAgvn" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[614bf676-a293-455d-b7de-801cb1900c4a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpOcAgvn'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[27285d23-bebf-4b55-8701-235f28e2c1f8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ae199-69ec-440c-a738-d1352d1644cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6987162-78ff-43c8-a5d4-28bd8a105672]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]
Nov 08 15:14:55 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6170ef39-6474-4cb3-9d55-7bf02f90a374]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c38ef3-c84e-48c1-b98f-4bc32497ce72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:14:55 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.087s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[95551b00-4e58-47e6-9a3a-b2ac573c705f]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:14:55 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:14:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:14:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23532313962353335', 'path': '/dev/sde'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:14:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532313962353335', 'path': '/dev/sde'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:14:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lazy-loading 'flavor' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:14:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:14:56 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:14:56 user nova-compute[74788]:   <source dev="/dev/sde"/>
Nov 08 15:14:56 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:14:56 user nova-compute[74788]:   <serial>e75ebf1b-dff4-4520-83b3-0316ba582fa3</serial>
Nov 08 15:14:56 user nova-compute[74788]: </disk>
Nov 08 15:14:56 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:14:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:14:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:14:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] No VIF found with MAC fa:16:3e:da:70:0f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:14:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbyufJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:00 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:00 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:00 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b7d0a-f5b6-4857-b4b3-c5b88d2c231c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:15:00 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[689de12c-a5d4-4992-aeff-b3010da7a9c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479] added
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1dfb7-98ee-41b8-a1aa-147fc29b6b95]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[78321283-d37c-40a7-927e-f9a5deb728db]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIbyufJo {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIbyufJo" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6800be7-7060-4503-9f52-c2992dcf80d8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIbyufJo'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612458a-f7e3-41aa-b2bd-f368531c9b7e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5c23b-f064-4e14-a9ea-3644d7312c3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2861cc0-bd42-445b-8d19-b1c03d5b2102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260]
Nov 08 15:15:00 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f5dc9b-22a5-4c00-880c-d86fc4d3ebab]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d87bbd-f1dc-46ed-b62e-2611733db207]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b7055d-8d4b-438e-9e9d-9d8073c09147]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbyufJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:15:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23663663761656266', 'path': '/dev/sdf'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663663761656266', 'path': '/dev/sdf'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:15:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'flavor' on Instance uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:15:01 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:01 user nova-compute[74788]:   <source dev="/dev/sdf"/>
Nov 08 15:15:01 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:01 user nova-compute[74788]:   <serial>7854dd9d-a857-4e28-9e2a-b8df26f30479</serial>
Nov 08 15:15:01 user nova-compute[74788]: </disk>
Nov 08 15:15:01 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No VIF found with MAC fa:16:3e:f3:c6:cf, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIvNKDdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:02 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:02 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:02 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049bab3-c2db-4123-8e0f-e52da00d61e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:15:02 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e9bc7-3e71-4ce2-bfc5-cb0592eefd33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5] added
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118d8ab-9326-4496-854d-396713e325c6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e1331b-3140-4949-aaf5-a16d500a9fd2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIvNKDdo {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIvNKDdo" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a22272-e712-4fdb-9391-f2ed93995b51]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tIvNKDdo'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c70ba1-63cc-46f2-a770-f18733bc1d18]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b23f9f-d771-42b4-b398-dd9ff8a71daf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4b954375-4e10-4869-ad0b-1e974d740542 tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.291s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ec844-d191-4d96-8602-78406604db20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260]
Nov 08 15:15:02 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced8242-bc22-4d84-9ad8-05762c13da33]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac0af7-6aa2-4940-bb13-4f5006113054]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8d406a-6aa4-43eb-ba35-689b20e7d6a3]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIvNKDdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-063ccef9-37b3-425e-a4de-38625b64bcf6 tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.808s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d7323b4f-bfdf-4430-83e5-dc40ba518fcd tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.952s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74788) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.utils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e27969-b189-4a27-8c8a-cdbc04b9e5f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489dadc-5438-404a-b281-e7227ce32ca1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557288a-2f65-495a-8457-47a8c159ca8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac04f772-b8fc-4ebc-8c57-0d5a15527a14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23134613633353262', 'path': '/dev/sdg'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134613633353262', 'path': '/dev/sdg'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:03 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:15:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9a5e80-671f-43dd-8a66-1abb51b63aa6]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG os_brick.utils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating existing volume attachment record: ee516c68-4e20-4a29-a237-1926112b9eb5 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:15:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lazy-loading 'flavor' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 15:15:04 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:04 user nova-compute[74788]:   <source dev="/dev/sdg"/>
Nov 08 15:15:04 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:04 user nova-compute[74788]:   <serial>34729c44-42d1-4ca8-8d93-c5ca877831b5</serial>
Nov 08 15:15:04 user nova-compute[74788]: </disk>
Nov 08 15:15:04 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:04 user nova-compute[74788]: WARNING nova.compute.manager [req-cd5b2c7e-4e9c-4c60-863e-79d9bb427c09 req-514ebba7-0f85-4ab3-a764-761385b6c5aa service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state active and task_state powering-off.
Nov 08 15:15:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] No VIF found with MAC fa:16:3e:a9:71:76, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:15:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance destroyed successfully.
Nov 08 15:15:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7ea51ee7-0489-4983-923a-6c1be0c4cd63 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.362s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:05 user nova-compute[74788]: INFO nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Rebuilding instance
Nov 08 15:15:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:05 user nova-compute[74788]: WARNING nova.compute.manager [req-b807f391-efe7-4062-9204-43ea34426443 req-761e9677-02d1-4a57-bf02-9dbca1c1768a service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state active and task_state rebuilding.
Nov 08 15:15:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance destroyed successfully.
Nov 08 15:15:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance destroyed successfully.
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431378698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaba69107-b8, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e0c6393-209c-4fea-8175-33b4be67e2ad) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:06 user nova-compute[74788]: INFO os_vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8')
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d1d21-e52d-4965-bc34-0297fd1222db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:15:06 user nova-compute[74788]: No targets found.
Nov 08 15:15:06 user nova-compute[74788]: iSNS:
Nov 08 15:15:06 user nova-compute[74788]: No targets found.
Nov 08 15:15:06 user nova-compute[74788]: STATIC:
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144
Nov 08 15:15:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:06 user nova-compute[74788]: FIRMWARE:
Nov 08 15:15:06 user nova-compute[74788]: No targets found.
Nov 08 15:15:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:15:06 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:15:06 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a38c6d-9926-4051-b67f-9c276aa9a997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:06 user nova-compute[74788]: WARNING nova.compute.manager [req-bca5abc4-e6f7-4d3f-b7f7-d5af0a80b43e req-327b09c5-9cac-4cbf-9b74-38c56725ba3a service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state None.
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[da074db4-ce51-4e65-a678-45429ce12c57]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c321ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a42d3-e82c-43ac-863d-575b481492d7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f5e0e-350c-40ae-97de-d147090f3477]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ae6fe-09e9-4e0d-aa96-ec34b4f42e4a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf60f7-94cd-46bb-b461-97983b60c694]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a0885-2938-4f34-a290-84dcf89b6d7a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7494e326-e898-49c9-a916-548cf773c561]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]
Nov 08 15:15:06 user nova-compute[74788]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3602df70-ac63-4fbe-96b0-70a9ab37ecc9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== disconnect_volume: return (375ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:15:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deleting instance files /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5_del
Nov 08 15:15:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deletion of /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5_del complete
Nov 08 15:15:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74788) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 15:15:06 user nova-compute[74788]: INFO nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] UEFI support detected
Nov 08 15:15:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:15:07 user nova-compute[74788]: INFO nova.compute.claims [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Claim successful on node user
Nov 08 15:15:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:07 user nova-compute[74788]: WARNING nova.compute.manager [req-2057845f-0db4-437b-8098-cccc341d64f0 req-f3f7c9de-bd93-4fed-80ee-fff857382887 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state active and task_state rebuilding.
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:15:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.policy [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93fef888f2054e41b67520e217b9ae8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ac793f47a8441b93944f5612fd5986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:15:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Creating image(s)
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "/opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "/opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "/opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.308s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk 1073741824" returned: 0 in 0.061s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.220s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Successfully created port: dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Cannot resize image /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Ensure instance console log exists: /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Successfully updated port: dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquired lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-changed-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Refreshing instance network info cache due to event network-changed-dee41a64-a441-4641-9d43-8a1fb62ed5d0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] Acquiring lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating instance_info_cache with network_info: [{"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Releasing lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Instance network_info: |[{"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] Acquired lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Refreshing network info cache for port dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Start _get_guest_xml network_info=[{"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:15:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2047802173',display_name='tempest-TestServerVolumeAttachmentScenario-server-2047802173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2047802173',id=11,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRiGl2qPq/c7/dl0fgjKimCRY36makp0AYNTQsK1kjg0AucqOhDqD8mtrg5m70TLBStymstIZdPtC37xc/EUaMpw0f20zLPO4uLsCbyipqngY0rOo1f6ofK7SDV+8KJdg==',key_name='tempest-keypair-2000952990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ac793f47a8441b93944f5612fd5986',ramdisk_id='',reservation_id='r-ivf1xm6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-616314953',owner_user_name='tempest-TestServerVolumeAttachmentScenario-616314953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93fef888f2054e41b67520e217b9ae8f',uuid=9357621e-cd81-491a-87ac-803f576688c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converting VIF {"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'pci_devices' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:15:10 user nova-compute[74788]:   <uuid>9357621e-cd81-491a-87ac-803f576688c2</uuid>
Nov 08 15:15:10 user nova-compute[74788]:   <name>instance-0000000b</name>
Nov 08 15:15:10 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:15:10 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:15:10 user nova-compute[74788]:   <metadata>
Nov 08 15:15:10 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:15:10 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2047802173</nova:name>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:15:10</nova:creationTime>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:15:10 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:15:10 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:owner>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:user uuid="93fef888f2054e41b67520e217b9ae8f">tempest-TestServerVolumeAttachmentScenario-616314953-project-member</nova:user>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:project uuid="e5ac793f47a8441b93944f5612fd5986">tempest-TestServerVolumeAttachmentScenario-616314953</nova:project>
Nov 08 15:15:10 user nova-compute[74788]:       </nova:owner>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:15:10 user nova-compute[74788]:       <nova:ports>
Nov 08 15:15:10 user nova-compute[74788]:         <nova:port uuid="dee41a64-a441-4641-9d43-8a1fb62ed5d0">
Nov 08 15:15:10 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 15:15:10 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:10 user nova-compute[74788]:       </nova:ports>
Nov 08 15:15:10 user nova-compute[74788]:     </nova:instance>
Nov 08 15:15:10 user nova-compute[74788]:   </metadata>
Nov 08 15:15:10 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:15:10 user nova-compute[74788]:     <system>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="serial">9357621e-cd81-491a-87ac-803f576688c2</entry>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="uuid">9357621e-cd81-491a-87ac-803f576688c2</entry>
Nov 08 15:15:10 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:15:10 user nova-compute[74788]:     </system>
Nov 08 15:15:10 user nova-compute[74788]:   </sysinfo>
Nov 08 15:15:10 user nova-compute[74788]:   <os>
Nov 08 15:15:10 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:15:10 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:15:10 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:15:10 user nova-compute[74788]:   </os>
Nov 08 15:15:10 user nova-compute[74788]:   <features>
Nov 08 15:15:10 user nova-compute[74788]:     <acpi/>
Nov 08 15:15:10 user nova-compute[74788]:     <apic/>
Nov 08 15:15:10 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:15:10 user nova-compute[74788]:   </features>
Nov 08 15:15:10 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:15:10 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:15:10 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:15:10 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:15:10 user nova-compute[74788]:   </clock>
Nov 08 15:15:10 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:15:10 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:15:10 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:15:10 user nova-compute[74788]:   </cpu>
Nov 08 15:15:10 user nova-compute[74788]:   <devices>
Nov 08 15:15:10 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:15:10 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:15:10 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk"/>
Nov 08 15:15:10 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:15:10 user nova-compute[74788]:     </disk>
Nov 08 15:15:10 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:10 user nova-compute[74788]:       <mac address="fa:16:3e:02:b2:66"/>
Nov 08 15:15:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:10 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:10 user nova-compute[74788]:       <target dev="tapdee41a64-a4"/>
Nov 08 15:15:10 user nova-compute[74788]:     </interface>
Nov 08 15:15:10 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:15:10 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/console.log" append="off"/>
Nov 08 15:15:10 user nova-compute[74788]:     </serial>
Nov 08 15:15:10 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:15:10 user nova-compute[74788]:     <video>
Nov 08 15:15:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:10 user nova-compute[74788]:     </video>
Nov 08 15:15:10 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:15:10 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:15:10 user nova-compute[74788]:     </rng>
Nov 08 15:15:10 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:15:10 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:15:10 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:15:10 user nova-compute[74788]:     </memballoon>
Nov 08 15:15:10 user nova-compute[74788]:   </devices>
Nov 08 15:15:10 user nova-compute[74788]: </domain>
Nov 08 15:15:10 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2047802173',display_name='tempest-TestServerVolumeAttachmentScenario-server-2047802173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2047802173',id=11,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRiGl2qPq/c7/dl0fgjKimCRY36makp0AYNTQsK1kjg0AucqOhDqD8mtrg5m70TLBStymstIZdPtC37xc/EUaMpw0f20zLPO4uLsCbyipqngY0rOo1f6ofK7SDV+8KJdg==',key_name='tempest-keypair-2000952990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5ac793f47a8441b93944f5612fd5986',ramdisk_id='',reservation_id='r-ivf1xm6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-616314953',owner_user_name='tempest-TestServerVolumeAttachmentScenario-616314953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93fef888f2054e41b67520e217b9ae8f',uuid=9357621e-cd81-491a-87ac-803f576688c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converting VIF {"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG os_vif [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fdb2de6-2e2a-5b1a-9958-a541facf895f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdee41a64-a4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdee41a64-a4, col_values=(('qos', UUID('c5d282c5-31f6-41b3-8167-1f2b99580433')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdee41a64-a4, col_values=(('external_ids', {'iface-id': 'dee41a64-a441-4641-9d43-8a1fb62ed5d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b2:66', 'vm-uuid': '9357621e-cd81-491a-87ac-803f576688c2'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:10 user nova-compute[74788]: INFO os_vif [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4')
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No VIF found with MAC fa:16:3e:02:b2:66, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updated VIF entry in instance network info cache for port dee41a64-a441-4641-9d43-8a1fb62ed5d0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating instance_info_cache with network_info: [{"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:15:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-941c67e3-4941-438c-aaf1-179fa6abeb94 req-257fc633-2151-4bf7-b6f7-4cc481654e1a service nova] Releasing lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:15:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] No waiting events found dispatching network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:12 user nova-compute[74788]: WARNING nova.compute.manager [req-692cf3ba-5a91-4709-b01e-c1572f9c12cc req-2fb32084-785f-403c-8dc5-629fdab3b28b service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received unexpected event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 for instance with vm_state building and task_state spawning.
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:15:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Instance spawned successfully.
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] No waiting events found dispatching network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:14 user nova-compute[74788]: WARNING nova.compute.manager [req-a713cbb4-510b-42fd-8d4c-67e60079c9cc req-abea03ba-e3b4-4fdd-bdfa-9cbda086c172 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received unexpected event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 for instance with vm_state building and task_state spawning.
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:14 user nova-compute[74788]: INFO nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 08 15:15:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:15:14 user nova-compute[74788]: INFO nova.compute.manager [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Took 6.70 seconds to build instance.
Nov 08 15:15:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e34bef59-a513-4e8c-ac8e-e38f90b77067 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.837s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-10013f0b-2ce1-4248-8265-130f91bb4bd3 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.401s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:15:29 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Creating image(s)
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Ensure instance console log exists: /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Start _get_guest_xml network_info=[{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJOFXkRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3eb0aa7-8425-466e-b5e8-20186e80121e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb450b81-c61c-4b4f-be45-59cbfd0760cc', 'serial': 'fb450b81-c61c-4b4f-be45-59cbfd0760cc'}, 'attachment_id': '25a5bf5b-e614-4129-89f1-b5e1037e58c4', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpjUkdlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3eb0aa7-8425-466e-b5e8-20186e80121e', 'attached_at': '', 'detached_at': '', 'volume_id': '589db95a-8e57-45ef-9d18-91ea223c4788', 'serial': '589db95a-8e57-45ef-9d18-91ea223c4788'}, 'attachment_id': '2fc70326-081c-416a-aa17-728754a30c6a', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVbjiZhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3eb0aa7-8425-466e-b5e8-20186e80121e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8d672ae-d8b1-4e47-af05-b239aa6dd181', 'serial': 'b8d672ae-d8b1-4e47-af05-b239aa6dd181'}, 'attachment_id': '8ecb62a9-f918-43fe-9b50-1ca08d157486', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:15:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJOFXkRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:29 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:29 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.013s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:29 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 could not be found.
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d23df-aa06-4e6f-b788-472149d3216e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:15:29 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:29 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ca0cb-645c-4c67-9d42-1787fe9926f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc] added
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[498800f3-afd8-4d3e-bfe6-fb6825b84824]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f001405-53d4-4f66-94ca-e8560e636ff8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJOFXkRu {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJOFXkRu" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded35c9-3165-4c1e-92a1-c41506e64da9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJOFXkRu'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362eef2-7e4e-42fe-871c-cd9dba740ba0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc37804-e372-446f-bcf9-5360f67acde7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305e211-7fb0-4bf7-a4b9-49417f56c138]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260]
Nov 08 15:15:29 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e231e24-92f0-4dac-9a91-0200d658ec9b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eb8b79-a38f-470a-93fb-601dcf3ab755]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:29 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3656892-dbf2-4606-b72a-66ae21b48c04]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:29 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [{"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-8880bfb1-f356-4e45-b6e8-06eba6d41cf9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:30 user nova-compute[74788]: INFO nova.compute.manager [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Detaching volume cdc5f952-33ee-4d95-b13c-aad482853144
Nov 08 15:15:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] volume_snapshot_create: create_info: {'snapshot_id': '6d4ce812-b50d-44e1-9d47-c6a45b0d51ed', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74788) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] snap xml: <domainsnapshot>
Nov 08 15:15:30 user nova-compute[74788]:   <disks>
Nov 08 15:15:30 user nova-compute[74788]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 08 15:15:30 user nova-compute[74788]:       <source file="/dev/new_file"/>
Nov 08 15:15:30 user nova-compute[74788]:     </disk>
Nov 08 15:15:30 user nova-compute[74788]:     <disk name="vda" snapshot="no"/>
Nov 08 15:15:30 user nova-compute[74788]:   </disks>
Nov 08 15:15:30 user nova-compute[74788]: </domainsnapshot>
Nov 08 15:15:30 user nova-compute[74788]:  {{(pid=74788) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] Lazy-loading 'system_metadata' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:30 user nova-compute[74788]: INFO nova.virt.block_device [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Attempting to driver detach volume cdc5f952-33ee-4d95-b13c-aad482853144 from mountpoint /dev/vdb
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Attempting to detach device vdb from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:30 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:30 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:15:30 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:30 user nova-compute[74788]:   <serial>cdc5f952-33ee-4d95-b13c-aad482853144</serial>
Nov 08 15:15:30 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 15:15:30 user nova-compute[74788]: </disk>
Nov 08 15:15:30 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 15:15:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully detached device vdb from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the persistent domain config.
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:30 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:30 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:15:30 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:30 user nova-compute[74788]:   <serial>cdc5f952-33ee-4d95-b13c-aad482853144</serial>
Nov 08 15:15:30 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 15:15:30 user nova-compute[74788]: </disk>
Nov 08 15:15:30 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Traceback (most recent call last):
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     rv = execute(f, *args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     six.reraise(c, e, tb)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     raise value
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     rv = meth(*args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] 
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Traceback (most recent call last):
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     self._volume_snapshot_create(context, instance, guest,
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     rv = execute(f, *args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     six.reraise(c, e, tb)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     raise value
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     rv = meth(*args, **kwargs)
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] 
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-084bc4c8-ca04-4c93-be92-85e972803e06 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] volume_snapshot_delete: delete_info: {'volume_id': '34729c44-42d1-4ca8-8d93-c5ca877831b5'} {{(pid=74788) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [None req-084bc4c8-ca04-4c93-be92-85e972803e06 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Traceback (most recent call last):
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d]     if delete_info['type'] != 'qcow2':
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] KeyError: 'type'
Nov 08 15:15:30 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] 
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.utils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e21a8a-8ab8-4622-9d7b-b81c19593a20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bfebc4-6c02-472a-941c-641ea9c167bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJOFXkRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26562353731613061', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562353731613061', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea21584-9c8b-499b-8310-1ead037eba0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.339s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d103a42a-d735-4df2-9435-ac02f661f026]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3810b533-9874-4e64-a674-f3033af9cb00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6d4ce812-b50d-44e1-9d47-c6a45b0d51ed could not be found.
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6d4ce812-b50d-44e1-9d47-c6a45b0d51ed could not be found. (HTTP 404) (Request-ID: req-1795aa55-6d3c-4059-acbd-502e9bb0e1e7)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6d4ce812-b50d-44e1-9d47-c6a45b0d51ed could not be found.
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:15:31 user nova-compute[74788]: No targets found.
Nov 08 15:15:31 user nova-compute[74788]: iSNS:
Nov 08 15:15:31 user nova-compute[74788]: No targets found.
Nov 08 15:15:31 user nova-compute[74788]: STATIC:
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144
Nov 08 15:15:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:31 user nova-compute[74788]: FIRMWARE:
Nov 08 15:15:31 user nova-compute[74788]: No targets found.
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:15:31 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:15:31 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server [None req-7ae1d33c-b9da-4bd0-a4c8-0410ebba98a3 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server 
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:31 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2eefd-4593-4885-bd9f-6040f17a8359]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.utils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cabcfd-5c7d-4c7f-9d3a-531fbb527a90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver [None req-084bc4c8-ca04-4c93-be92-85e972803e06 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-033e33d7-dfee-4ee8-8e88-98c008f6f13b)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 15:15:31 user nova-compute[74788]: ERROR nova.virt.libvirt.driver 
Nov 08 15:15:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpjUkdlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:31 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server [None req-084bc4c8-ca04-4c93-be92-85e972803e06 tempest-VolumesAssistedSnapshotsTest-1636828260 tempest-VolumesAssistedSnapshotsTest-1636828260-project] Exception during message handling: KeyError: 'type'
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 15:15:31 user nova-compute[74788]: ERROR oslo_messaging.rpc.server 
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9cb34-9fef-4971-a0bb-66a8475183ad]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c5e9120>, {}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Disconnecting from: [] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.156s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== disconnect_volume: return (1495ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.035s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:31 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:31 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278cd62-fe56-4d1f-9ed3-532a56d95bed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:15:31 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e1b816-ee11-4516-9c6b-9f30fbe40cf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788] added
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea4be0-cf2c-4172-9479-90ed599aeebe]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: INFO nova.compute.manager [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Detaching volume 7854dd9d-a857-4e28-9e2a-b8df26f30479
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f356547a-84b0-4ffc-8447-f356558c9598]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpjUkdlW {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpjUkdlW" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebbad0b-46ce-4cda-9073-1ae96b44e6d2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpjUkdlW'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7cde17-e691-4961-91fd-ef5a26a51029]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3abc44-8619-4f22-9d1d-8d7060f3b576]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd287eb5-5685-4854-b678-e9b002c1d69a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260]
Nov 08 15:15:31 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66d2faa-a680-43a1-8737-3e8bb02f5547]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b3bd1c-9010-4385-83ff-65527e78bc43]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:31 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537b52f-0f7d-45f9-b8a7-ffe3c8e4b7f3]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpjUkdlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23165636435343365', 'path': '/dev/sdh'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165636435343365', 'path': '/dev/sdh'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Preparing to wait for external event volume-reimaged-2b5251fd-3275-45d8-994c-180882761901 {{(pid=74788) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: INFO nova.compute.manager [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Swapping volume e75ebf1b-dff4-4520-83b3-0316ba582fa3 for c6eedca6-20a0-493c-894f-8376631a2085
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVbjiZhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:32 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:32 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:32 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d412bc9f-90e5-4033-aa12-1ab82169d195]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:15:32 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e78d5d-01ff-42b3-a06c-21701ca2c162]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181] added
Nov 08 15:15:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[77872041-5bab-48e7-8a7d-93ccc4e9e49a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[963cd6c5-a575-40b1-9c30-fbf1aa615bc8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVbjiZhe {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: INFO nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Booting with volume d066e3ee-9f47-4bd7-b38a-6162bea94113 at /dev/vdc
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.volume.cinder [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Update attachment failed for attachment ee516c68-4e20-4a29-a237-1926112b9eb5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55)
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVbjiZhe" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d30918d-9496-4f02-837e-d77de236f8b5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: INFO nova.virt.block_device [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Attempting to driver detach volume 7854dd9d-a857-4e28-9e2a-b8df26f30479 from mountpoint /dev/vdb
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVbjiZhe'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed284e29-5848-4383-b368-4bae631d7696]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Failed to attach e7bc6599-e893-4c4b-8d95-c8a5073abacd at /dev/sdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Traceback (most recent call last):
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     self._volume_attach(context, volume, connector, instance,
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     connection_info = volume_api.attachment_update(
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     res = method(self, ctx, *args, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     with excutils.save_and_reraise_exception():
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     self.force_reraise()
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     raise self.value
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     return method.func(obj, *args, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     return self.request(url, method, **kwargs)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9]     raise exceptions.from_response(resp, body)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55)
Nov 08 15:15:32 user nova-compute[74788]: ERROR nova.compute.manager [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] 
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Attempting to detach device vdb from instance 966892ee-94c8-442e-911d-54941e0efdbd from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:32 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:32 user nova-compute[74788]:   <source dev="/dev/sdf"/>
Nov 08 15:15:32 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:32 user nova-compute[74788]:   <serial>7854dd9d-a857-4e28-9e2a-b8df26f30479</serial>
Nov 08 15:15:32 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:15:32 user nova-compute[74788]: </disk>
Nov 08 15:15:32 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:32 user nova-compute[74788]: INFO nova.compute.manager [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Detaching volume 34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully detached device vdb from instance 966892ee-94c8-442e-911d-54941e0efdbd from the persistent domain config.
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 966892ee-94c8-442e-911d-54941e0efdbd from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:32 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:32 user nova-compute[74788]:   <source dev="/dev/sdf"/>
Nov 08 15:15:32 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:32 user nova-compute[74788]:   <serial>7854dd9d-a857-4e28-9e2a-b8df26f30479</serial>
Nov 08 15:15:32 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:15:32 user nova-compute[74788]: </disk>
Nov 08 15:15:32 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de488b71-0d5a-48d2-8744-43eed00f5c66]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:32 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ee487-2de9-4df4-aa9b-925e5070b81a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee1112-fadb-4da6-8655-e44181a4896f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: INFO nova.virt.block_device [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Attempting to driver detach volume 34729c44-42d1-4ca8-8d93-c5ca877831b5 from mountpoint /dev/vdb
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f110ed-5a49-448c-b7f4-1f923799183e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab17ef-c321-4ce4-911a-14b876bd91af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260]
Nov 08 15:15:33 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[925c561a-fbd0-4633-9bfe-dc3dcd69a857]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288aa6d-1a65-48be-81fb-7fcf59d5ffa5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Attempting to detach device vdb from instance 5e2c5895-77ac-4012-a746-183e8a9c841d from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:33 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:33 user nova-compute[74788]:   <source dev="/dev/sdg"/>
Nov 08 15:15:33 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:33 user nova-compute[74788]:   <serial>34729c44-42d1-4ca8-8d93-c5ca877831b5</serial>
Nov 08 15:15:33 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:15:33 user nova-compute[74788]: </disk>
Nov 08 15:15:33 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.971s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:33 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed7fea-15bf-4858-820c-6796dbbcba21]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.utils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== get_connector_properties: return (270ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating existing volume attachment record: 05ecd146-062c-4724-aed7-683d1b00b050 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af418d4-695e-43bb-9ada-7877150caade]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Successfully detached device vdb from instance 5e2c5895-77ac-4012-a746-183e8a9c841d from the persistent domain config.
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e2c5895-77ac-4012-a746-183e8a9c841d from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 15:15:33 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:33 user nova-compute[74788]:   <source dev="/dev/sdg"/>
Nov 08 15:15:33 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:15:33 user nova-compute[74788]:   <serial>34729c44-42d1-4ca8-8d93-c5ca877831b5</serial>
Nov 08 15:15:33 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:15:33 user nova-compute[74788]: </disk>
Nov 08 15:15:33 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:33 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.645s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[526db602-0369-4a89-9252-802a40aeba05]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVbjiZhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server [None req-0e0ecba0-ca95-4ed6-b69f-7d65ea26f580 tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c659ba07-fcae-4fad-b3f2-ea8eeabd3a55)
Nov 08 15:15:33 user nova-compute[74788]: ERROR oslo_messaging.rpc.server 
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:15:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.701s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== connect_volume: return (1706ms) {'type': 'block', 'scsi_wwn': '23334616664346132', 'path': '/dev/sdi'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334616664346132', 'path': '/dev/sdi'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.objects.instance [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lazy-loading 'pci_devices' on Instance uuid a3eb0aa7-8425-466e-b5e8-20186e80121e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:15:34 user nova-compute[74788]:   <uuid>a3eb0aa7-8425-466e-b5e8-20186e80121e</uuid>
Nov 08 15:15:34 user nova-compute[74788]:   <name>instance-0000000a</name>
Nov 08 15:15:34 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:15:34 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:15:34 user nova-compute[74788]:   <metadata>
Nov 08 15:15:34 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:15:34 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:name>tempest-device-tagging-server-1796737526</nova:name>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:15:29</nova:creationTime>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:15:34 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:15:34 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:owner>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:user uuid="6d79cdc433984f32b193b6334732d5f3">tempest-TaggedBootDevicesTest_v242-76015565-project-member</nova:user>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:project uuid="267e279227b64367abe0b6f3d039de11">tempest-TaggedBootDevicesTest_v242-76015565</nova:project>
Nov 08 15:15:34 user nova-compute[74788]:       </nova:owner>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:15:34 user nova-compute[74788]:       <nova:ports>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="dd776e2c-f6f1-48cd-8c52-ea24de7b90ee">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="af9a7b4d-f41c-4210-a8fa-8b56a6abe02e">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="fcd5386a-a476-4bb0-a6a3-f88c500b3b89">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="1807f7bc-d09c-457b-9da0-eba51c82ae67">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="c2ebf52e-0769-424d-bd4f-721dda443697">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="7f03eb0d-2b92-418a-9630-5c836354c0fe">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:         <nova:port uuid="d2e7e46b-b063-4391-88f0-cb90487c6f92">
Nov 08 15:15:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 15:15:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:15:34 user nova-compute[74788]:       </nova:ports>
Nov 08 15:15:34 user nova-compute[74788]:     </nova:instance>
Nov 08 15:15:34 user nova-compute[74788]:   </metadata>
Nov 08 15:15:34 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:15:34 user nova-compute[74788]:     <system>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="serial">a3eb0aa7-8425-466e-b5e8-20186e80121e</entry>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="uuid">a3eb0aa7-8425-466e-b5e8-20186e80121e</entry>
Nov 08 15:15:34 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:15:34 user nova-compute[74788]:     </system>
Nov 08 15:15:34 user nova-compute[74788]:   </sysinfo>
Nov 08 15:15:34 user nova-compute[74788]:   <os>
Nov 08 15:15:34 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:15:34 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:15:34 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:15:34 user nova-compute[74788]:   </os>
Nov 08 15:15:34 user nova-compute[74788]:   <features>
Nov 08 15:15:34 user nova-compute[74788]:     <acpi/>
Nov 08 15:15:34 user nova-compute[74788]:     <apic/>
Nov 08 15:15:34 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:15:34 user nova-compute[74788]:   </features>
Nov 08 15:15:34 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:15:34 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:15:34 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:15:34 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:15:34 user nova-compute[74788]:   </clock>
Nov 08 15:15:34 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:15:34 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:15:34 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:15:34 user nova-compute[74788]:   </cpu>
Nov 08 15:15:34 user nova-compute[74788]:   <devices>
Nov 08 15:15:34 user nova-compute[74788]:     <disk type="file" device="cdrom">
Nov 08 15:15:34 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 15:15:34 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/disk.config"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="hda" bus="ide"/>
Nov 08 15:15:34 user nova-compute[74788]:     </disk>
Nov 08 15:15:34 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:15:34 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:34 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <serial>fb450b81-c61c-4b4f-be45-59cbfd0760cc</serial>
Nov 08 15:15:34 user nova-compute[74788]:     </disk>
Nov 08 15:15:34 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:15:34 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:34 user nova-compute[74788]:       <source dev="/dev/sdh"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <serial>589db95a-8e57-45ef-9d18-91ea223c4788</serial>
Nov 08 15:15:34 user nova-compute[74788]:     </disk>
Nov 08 15:15:34 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:15:34 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:15:34 user nova-compute[74788]:       <source dev="/dev/sdi"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="vdc" bus="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <serial>b8d672ae-d8b1-4e47-af05-b239aa6dd181</serial>
Nov 08 15:15:34 user nova-compute[74788]:     </disk>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:a7:cd:cb"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tapdd776e2c-f6"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:0b:b8:4d"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tapaf9a7b4d-f4"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:71:de:dc"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tapfcd5386a-a4"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:bb:76:b7"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tap1807f7bc-d0"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:f5:a7:fa"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tapc2ebf52e-07"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:57:fc:73"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tap7f03eb0d-2b"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:15:34 user nova-compute[74788]:       <mac address="fa:16:3e:30:03:4e"/>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:15:34 user nova-compute[74788]:       <target dev="tapd2e7e46b-b0"/>
Nov 08 15:15:34 user nova-compute[74788]:     </interface>
Nov 08 15:15:34 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:15:34 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/console.log" append="off"/>
Nov 08 15:15:34 user nova-compute[74788]:     </serial>
Nov 08 15:15:34 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:15:34 user nova-compute[74788]:     <video>
Nov 08 15:15:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:15:34 user nova-compute[74788]:     </video>
Nov 08 15:15:34 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:15:34 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:15:34 user nova-compute[74788]:     </rng>
Nov 08 15:15:34 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:15:34 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:15:34 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:15:34 user nova-compute[74788]:     </memballoon>
Nov 08 15:15:34 user nova-compute[74788]:   </devices>
Nov 08 15:15:34 user nova-compute[74788]: </domain>
Nov 08 15:15:34 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd41b90a-eae6-569d-a763-2261909225ec', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd776e2c-f6, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd776e2c-f6, col_values=(('qos', UUID('c7da6c37-24fa-4dfb-91a3-8f54dca4091e')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd776e2c-f6, col_values=(('external_ids', {'iface-id': 'dd776e2c-f6f1-48cd-8c52-ea24de7b90ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:cd:cb', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6')
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb00322-3a20-5a35-a263-591f975a35ff', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf9a7b4d-f4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf9a7b4d-f4, col_values=(('qos', UUID('a6f1b22d-d437-43b2-b6c6-4f2aae68c540')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf9a7b4d-f4, col_values=(('external_ids', {'iface-id': 'af9a7b4d-f41c-4210-a8fa-8b56a6abe02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b8:4d', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4')
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '386d5d64-e89e-5804-ac1e-eacf6248177c', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcd5386a-a4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcd5386a-a4, col_values=(('qos', UUID('2c355483-e532-4b84-a6cd-744e62564408')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcd5386a-a4, col_values=(('external_ids', {'iface-id': 'fcd5386a-a476-4bb0-a6a3-f88c500b3b89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:de:dc', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=25.635265350341797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4')
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31e0d043-a646-5d1d-bf0e-8d626568ae18', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1807f7bc-d0, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1807f7bc-d0, col_values=(('qos', UUID('2feab133-a119-4ceb-82b8-e6fa53261294')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1807f7bc-d0, col_values=(('external_ids', {'iface-id': '1807f7bc-d09c-457b-9da0-eba51c82ae67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:76:b7', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'flavor' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0')
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 5e2c5895-77ac-4012-a746-183e8a9c841d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance a3eb0aa7-8425-466e-b5e8-20186e80121e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9357621e-cd81-491a-87ac-803f576688c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75f613a2-1df6-5365-8b83-46ffe9fd81ff', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ebf52e-07, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ebf52e-07, col_values=(('qos', UUID('6ea6e0ee-5ba1-4fe9-9b90-a868d13c9ecc')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ebf52e-07, col_values=(('external_ids', {'iface-id': 'c2ebf52e-0769-424d-bd4f-721dda443697', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a7:fa', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07')
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a58e66c4-5c4d-5b81-bc1a-8971ea8c33ab', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f03eb0d-2b, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f03eb0d-2b, col_values=(('qos', UUID('32c397da-4cd4-49e2-b93c-4814450f767d')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f03eb0d-2b, col_values=(('external_ids', {'iface-id': '7f03eb0d-2b92-418a-9630-5c836354c0fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:fc:73', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:35 user nova-compute[74788]: INFO nova.compute.manager [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Attaching volume edb139de-2a58-465f-8eb8-607ab11ae980 to /dev/vdb
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b')
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06ce34c5-b358-5635-9455-6b4eaaba7ec3', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.utils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2e7e46b-b0, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2e7e46b-b0, col_values=(('qos', UUID('78fb2e1a-769d-48b3-bfd4-e8123d963223')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2e7e46b-b0, col_values=(('external_ids', {'iface-id': 'd2e7e46b-b063-4391-88f0-cb90487c6f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:03:4e', 'vm-uuid': 'a3eb0aa7-8425-466e-b5e8-20186e80121e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa84eec-8828-4892-9d78-0a2a1f8319c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf83055-056b-42cb-aaac-4e61369a581a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c786843-aa22-4e6d-9f16-b1239dc89221]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70fe4e-bd22-4056-b5e3-943350978b87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:15:35 user nova-compute[74788]: INFO os_vif [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0')
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:15:35 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:15:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d4e26-895c-479b-adee-917bfd427ffa]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG os_brick.utils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:35 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating existing volume attachment record: 93e9e0ad-5986-4ef8-a4bd-b7ede722b612 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] No BDM found with device name hda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] No VIF found with MAC fa:16:3e:a7:cd:cb, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] No VIF found with MAC fa:16:3e:f5:a7:fa, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:15:36 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Using config drive
Nov 08 15:15:36 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Creating config drive at /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/disk.config
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpui95cxs6 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpui95cxs6" returned: 0 in 0.055s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:38 user nova-compute[74788]: WARNING nova.compute.manager [req-e7f5f9ea-d525-4a9c-9afd-a4890e727144 req-e4371170-2ed9-42a9-96ac-5dfce270dcc1 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee for instance with vm_state building and task_state spawning.
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:38 user nova-compute[74788]: WARNING nova.compute.manager [req-3acf63a9-a363-4dbb-a40e-0407442e4bb0 req-f0e12953-6ce9-4c7b-aa05-83cffb3a72b9 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 for instance with vm_state building and task_state spawning.
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:39 user nova-compute[74788]: WARNING nova.compute.manager [req-a8902c56-7163-4579-b1ad-eb08e446603b req-4749943e-a4c9-424c-9bcc-57b05f914a03 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 for instance with vm_state building and task_state spawning.
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee for instance with vm_state building and task_state spawning.
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e for instance with vm_state building and task_state spawning.
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e for instance with vm_state building and task_state spawning.
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 for instance with vm_state building and task_state spawning.
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-d73a979a-a736-4ee9-976f-323044c6921d req-090d3eb4-6268-4bfe-bae9-e7f16177114b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 for instance with vm_state building and task_state spawning.
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:40 user nova-compute[74788]: WARNING nova.compute.manager [req-3b42686d-b4c3-4e73-a070-6d43fdff6591 req-e244f4ec-be47-4e60-a000-273d868ae983 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 for instance with vm_state building and task_state spawning.
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:41 user nova-compute[74788]: WARNING nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 for instance with vm_state building and task_state spawning.
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:41 user nova-compute[74788]: WARNING nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe for instance with vm_state building and task_state spawning.
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:41 user nova-compute[74788]: WARNING nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe for instance with vm_state building and task_state spawning.
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:41 user nova-compute[74788]: WARNING nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 for instance with vm_state building and task_state spawning.
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:15:41 user nova-compute[74788]: WARNING nova.compute.manager [req-6c558e53-458f-44c6-bdfd-9c01e09dc218 req-d325b84c-93e2-4b1f-8783-8af798eb608d service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 for instance with vm_state building and task_state spawning.
Nov 08 15:15:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:15:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance spawned successfully.
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:15:42 user nova-compute[74788]: INFO nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Took 12.92 seconds to spawn the instance on the hypervisor.
Nov 08 15:15:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:15:42 user nova-compute[74788]: INFO nova.compute.manager [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Took 120.08 seconds to build instance.
Nov 08 15:15:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-73fed1f6-2504-456b-952b-1e9395e059ae tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 120.209s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:15:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 is timed out.
Nov 08 15:15:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully detached device vdb from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the live domain config.
Nov 08 15:15:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NSUbFlCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:51 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b0ef4-3785-460b-bea6-d1a719981a52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:15:51 user nova-compute[74788]: No targets found.
Nov 08 15:15:51 user nova-compute[74788]: iSNS:
Nov 08 15:15:51 user nova-compute[74788]: No targets found.
Nov 08 15:15:51 user nova-compute[74788]: STATIC:
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144
Nov 08 15:15:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:51 user nova-compute[74788]: FIRMWARE:
Nov 08 15:15:51 user nova-compute[74788]: No targets found.
Nov 08 15:15:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:15:51 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:15:51 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c99b7c-d3d3-4d95-9518-dcabff34085b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc8539a-59d8-414a-8184-200a09bee9be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:51 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f775850dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cebcc26-eb9b-4344-9b77-fcf2810ad500]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a470b9-1680-4d2b-a13f-43bc910e6121]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219fadc-030f-4b2f-8624-9970b9d6f77c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[177d391f-ee5a-45a8-9a00-2ee21a207acc]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18737307-3c7e-4409-b08a-dbd7a6ccb3bd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a7fa5-ff2f-4c7c-9f07-b6116eb81653]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260]
Nov 08 15:15:51 user nova-compute[74788]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc5f952-33ee-4d95-b13c-aad482853144 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18414213-c0d4-4c9f-8637-def08f918848]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] <== disconnect_volume: return (344ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:15:53 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 966892ee-94c8-442e-911d-54941e0efdbd is timed out.
Nov 08 15:15:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully detached device vdb from instance 966892ee-94c8-442e-911d-54941e0efdbd from the live domain config.
Nov 08 15:15:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIbyufJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:53 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c0633-423d-4e87-b525-f23813f084a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]: iSNS:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]: STATIC:
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: FIRMWARE:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:15:53 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:15:53 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6913864-0128-45c0-93f1-f32eae3281d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[63906ad0-8f9e-4eb9-8630-b493870f64dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:53 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:53 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758502950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479'): ({'sdf'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Removing single pathed devices sdf {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4be37ac-8f0b-4a33-a9fd-fd2b2d7b5664]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[83639aac-9b4a-4459-ae7a-6726c06c65be]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Flushing IO for device /dev/sdf {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[349cf225-0204-4415-a68c-f048c7d15de7]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.074s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cc8585-8fb2-4a1a-a631-79d948d12d23]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] SCSI volumes sdf have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e2c5895-77ac-4012-a746-183e8a9c841d is timed out.
Nov 08 15:15:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Successfully detached device vdb from instance 5e2c5895-77ac-4012-a746-183e8a9c841d from the live domain config.
Nov 08 15:15:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIvNKDdo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:15:53 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea6002-535f-4f47-a77d-b3deea4dff80]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6899c886-7609-40df-bf27-3dcbb7c9789a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260]
Nov 08 15:15:53 user nova-compute[74788]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:53 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7854dd9d-a857-4e28-9e2a-b8df26f30479 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[98faa6cd-7f8b-4870-904d-be22d0940cc3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] <== disconnect_volume: return (470ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.166s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e90855-515d-43cb-b7f3-7a23b0adb9cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]: iSNS:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]: STATIC:
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5
Nov 08 15:15:53 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:15:53 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:15:53 user nova-compute[74788]: FIRMWARE:
Nov 08 15:15:53 user nova-compute[74788]: No targets found.
Nov 08 15:15:53 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:15:54 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:15:54 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0bb5b4-2837-487a-a853-dd0874da6e41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f352f4-38bc-4512-81e2-b49c4b5abb03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:15:54 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:15:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c7a7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5'): ({'sdg'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Removing single pathed devices sdg {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf18f6c-c369-4bad-83b0-a62653a9f301]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd833e7-d27e-4a5f-916a-9da409344dfb]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Flushing IO for device /dev/sdg {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1373662-27eb-4dc7-9023-38a54dc8918b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bfc0e-4a07-4689-bcd8-5634b0c0b600]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] SCSI volumes sdg have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e6c590-8c00-4a02-8401-b20262df9693]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf6ea5-41f5-4309-870c-e12823775d70]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260]
Nov 08 15:15:54 user nova-compute[74788]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5, portal: 172.16.0.220,3260] successful.
Nov 08 15:15:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34729c44-42d1-4ca8-8d93-c5ca877831b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308a9b7-7734-4793-ac0b-7adb59a75f84]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] <== disconnect_volume: return (566ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:15:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:15:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG nova.compute.manager [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085', 'serial': 'c6eedca6-20a0-493c-894f-8376631a2085'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'serial'} {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:01 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:01 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:01 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[34673a4c-764d-459e-9ccb-3c786369dfb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:01 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[869875eb-ce67-42b5-b8ae-0fd9df28db1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085] added
Nov 08 15:16:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5db24-94d2-4c83-9ba1-ff53dab717c4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433bf2f-46a9-46fe-8652-959acefb6162]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLaQjIpb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLaQjIpb" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f07060-5bbe-4cb5-87e5-377e48cea207]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLaQjIpb'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253576c-1576-486d-84a1-e2be98e49891]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d36f3-a547-43b8-9451-9a81b26908e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:01 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[63469f51-617f-47dd-b581-3d1353ae9b9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260]
Nov 08 15:16:01 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153f9ab-16f4-4006-93f6-69b809657fad]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335b699-9754-4101-a02a-06c40ccad740]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:02 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ffce6-71e9-4d25-b2cb-1747157f9793]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23639623163393834', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639623163393834', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lazy-loading 'flavor' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-965ec703-11d5-4c5d-88ff-96ed778155aa tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.589s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'flavor' on Instance uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a2dbe421-a80d-45b8-b4c5-e8aa68deb64a tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.166s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 145752064 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:16:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Creating image(s)
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Ensure instance console log exists: /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Start _get_guest_xml network_info=[{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TApeyDuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8', 'attached_at': '', 'detached_at': '', 'volume_id': '0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 'serial': '0c500d05-0bfc-42e7-9c57-0507d9e4ece4'}, 'attachment_id': '2bed1bf3-7c51-4ef8-bf7c-050def6e7967', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UblkdPma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8', 'attached_at': '', 'detached_at': '', 'volume_id': '55d3fdfe-f44b-4e17-8475-e195b5312b3b', 'serial': '55d3fdfe-f44b-4e17-8475-e195b5312b3b'}, 'attachment_id': '956d83af-1280-4dd0-a823-3d19887e036a', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlneyMUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd066e3ee-9f47-4bd7-b38a-6162bea94113', 'serial': 'd066e3ee-9f47-4bd7-b38a-6162bea94113'}, 'attachment_id': '05ecd146-062c-4724-aed7-683d1b00b050', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:16:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TApeyDuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:04 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eff607-a7aa-4f02-af67-db91dc439e31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:04 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[512daa35-6625-4874-afe8-57ea815e1616]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4] added
Nov 08 15:16:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206da91-f4da-4d47-b153-c26bca80ebcb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadaa9a7-82fb-4c32-b075-3e41096944d4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TApeyDuC {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TApeyDuC" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c0502-f244-49d9-8840-c796dea8175a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TApeyDuC'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-ddb63fbc-0493-4e78-9191-a897435bfabb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-ddb63fbc-0493-4e78-9191-a897435bfabb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666871f-f210-4d0d-89f8-4d2abb584e43]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lazy-loading 'flavor' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a34c8-839b-4b1c-bc6b-3a54c95c9765]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Attempting to detach device tapddb63fbc-04 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] detach device xml: <interface type="ethernet">
Nov 08 15:16:05 user nova-compute[74788]:   <mac address="fa:16:3e:ce:c0:46"/>
Nov 08 15:16:05 user nova-compute[74788]:   <model type="virtio"/>
Nov 08 15:16:05 user nova-compute[74788]:   <mtu size="1442"/>
Nov 08 15:16:05 user nova-compute[74788]:   <target dev="tapddb63fbc-04"/>
Nov 08 15:16:05 user nova-compute[74788]: </interface>
Nov 08 15:16:05 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 15:16:05 user nova-compute[74788]:   <name>instance-00000005</name>
Nov 08 15:16:05 user nova-compute[74788]:   <uuid>9b540dd4-ac0f-41a2-941a-a7dd519d2922</uuid>
Nov 08 15:16:05 user nova-compute[74788]:   <metadata>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:05 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:14:04</nova:creationTime>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:05 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:05 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:05 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:05 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:05 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:05 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:05 user nova-compute[74788]:     <nova:port uuid="ddb63fbc-0493-4e78-9191-a897435bfabb">
Nov 08 15:16:05 user nova-compute[74788]:       <nova:ip type="fixed" address="10.10.10.252" ipVersion="4"/>
Nov 08 15:16:05 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:05 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:05 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:05 user nova-compute[74788]:   </metadata>
Nov 08 15:16:05 user nova-compute[74788]:   <memory unit='KiB'>524288</memory>
Nov 08 15:16:05 user nova-compute[74788]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 15:16:05 user nova-compute[74788]:   <vcpu placement='static'>1</vcpu>
Nov 08 15:16:05 user nova-compute[74788]:   <resource>
Nov 08 15:16:05 user nova-compute[74788]:     <partition>/machine</partition>
Nov 08 15:16:05 user nova-compute[74788]:   </resource>
Nov 08 15:16:05 user nova-compute[74788]:   <sysinfo type='smbios'>
Nov 08 15:16:05 user nova-compute[74788]:     <system>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='version'>0.0.0</entry>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='serial'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='uuid'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:05 user nova-compute[74788]:       <entry name='family'>Virtual Machine</entry>
Nov 08 15:16:05 user nova-compute[74788]:     </system>
Nov 08 15:16:05 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:05 user nova-compute[74788]:   <os>
Nov 08 15:16:05 user nova-compute[74788]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 15:16:05 user nova-compute[74788]:     <boot dev='hd'/>
Nov 08 15:16:05 user nova-compute[74788]:     <smbios mode='sysinfo'/>
Nov 08 15:16:05 user nova-compute[74788]:   </os>
Nov 08 15:16:05 user nova-compute[74788]:   <features>
Nov 08 15:16:05 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:05 user nova-compute[74788]:     <apic/>
Nov 08 15:16:05 user nova-compute[74788]:     <vmcoreinfo state='on'/>
Nov 08 15:16:05 user nova-compute[74788]:   </features>
Nov 08 15:16:05 user nova-compute[74788]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 15:16:05 user nova-compute[74788]:     <model fallback='forbid'>Nehalem</model>
Nov 08 15:16:05 user nova-compute[74788]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 15:16:05 user nova-compute[74788]:     <feature policy='require' name='vme'/>
Nov 08 15:16:05 user nova-compute[74788]:     <feature policy='require' name='x2apic'/>
Nov 08 15:16:05 user nova-compute[74788]:     <feature policy='require' name='hypervisor'/>
Nov 08 15:16:05 user nova-compute[74788]:   </cpu>
Nov 08 15:16:05 user nova-compute[74788]:   <clock offset='utc'>
Nov 08 15:16:05 user nova-compute[74788]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 15:16:05 user nova-compute[74788]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 15:16:05 user nova-compute[74788]:     <timer name='hpet' present='no'/>
Nov 08 15:16:05 user nova-compute[74788]:   </clock>
Nov 08 15:16:05 user nova-compute[74788]:   <on_poweroff>destroy</on_poweroff>
Nov 08 15:16:05 user nova-compute[74788]:   <on_reboot>restart</on_reboot>
Nov 08 15:16:05 user nova-compute[74788]:   <on_crash>destroy</on_crash>
Nov 08 15:16:05 user nova-compute[74788]:   <devices>
Nov 08 15:16:05 user nova-compute[74788]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 15:16:05 user nova-compute[74788]:     <disk type='file' device='disk'>
Nov 08 15:16:05 user nova-compute[74788]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 15:16:05 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk' index='2'/>
Nov 08 15:16:05 user nova-compute[74788]:       <backingStore type='file' index='3'>
Nov 08 15:16:05 user nova-compute[74788]:         <format type='raw'/>
Nov 08 15:16:05 user nova-compute[74788]:         <source file='/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9'/>
Nov 08 15:16:05 user nova-compute[74788]:         <backingStore/>
Nov 08 15:16:05 user nova-compute[74788]:       </backingStore>
Nov 08 15:16:05 user nova-compute[74788]:       <target dev='vda' bus='virtio'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='virtio-disk0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </disk>
Nov 08 15:16:05 user nova-compute[74788]:     <disk type='file' device='cdrom'>
Nov 08 15:16:05 user nova-compute[74788]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 15:16:05 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config' index='1'/>
Nov 08 15:16:05 user nova-compute[74788]:       <backingStore/>
Nov 08 15:16:05 user nova-compute[74788]:       <target dev='hda' bus='ide'/>
Nov 08 15:16:05 user nova-compute[74788]:       <readonly/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='ide0-0-0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </disk>
Nov 08 15:16:05 user nova-compute[74788]:     <controller type='usb' index='0' model='none'>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='usb'/>
Nov 08 15:16:05 user nova-compute[74788]:     </controller>
Nov 08 15:16:05 user nova-compute[74788]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='pci.0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </controller>
Nov 08 15:16:05 user nova-compute[74788]:     <controller type='ide' index='0'>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='ide'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 15:16:05 user nova-compute[74788]:     </controller>
Nov 08 15:16:05 user nova-compute[74788]:     <interface type='ethernet'>
Nov 08 15:16:05 user nova-compute[74788]:       <mac address='fa:16:3e:3e:9d:5a'/>
Nov 08 15:16:05 user nova-compute[74788]:       <target dev='tap2d460349-ac'/>
Nov 08 15:16:05 user nova-compute[74788]:       <model type='virtio'/>
Nov 08 15:16:05 user nova-compute[74788]:       <mtu size='1442'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='net0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </interface>
Nov 08 15:16:05 user nova-compute[74788]:     <interface type='ethernet'>
Nov 08 15:16:05 user nova-compute[74788]:       <mac address='fa:16:3e:ce:c0:46'/>
Nov 08 15:16:05 user nova-compute[74788]:       <target dev='tapddb63fbc-04'/>
Nov 08 15:16:05 user nova-compute[74788]:       <model type='virtio'/>
Nov 08 15:16:05 user nova-compute[74788]:       <mtu size='1442'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='net1'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </interface>
Nov 08 15:16:05 user nova-compute[74788]:     <serial type='pty'>
Nov 08 15:16:05 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:05 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:05 user nova-compute[74788]:       <target type='isa-serial' port='0'>
Nov 08 15:16:05 user nova-compute[74788]:         <model name='isa-serial'/>
Nov 08 15:16:05 user nova-compute[74788]:       </target>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </serial>
Nov 08 15:16:05 user nova-compute[74788]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 15:16:05 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:05 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:05 user nova-compute[74788]:       <target type='serial' port='0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </console>
Nov 08 15:16:05 user nova-compute[74788]:     <input type='mouse' bus='ps2'>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='input0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </input>
Nov 08 15:16:05 user nova-compute[74788]:     <input type='keyboard' bus='ps2'>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='input1'/>
Nov 08 15:16:05 user nova-compute[74788]:     </input>
Nov 08 15:16:05 user nova-compute[74788]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 15:16:05 user nova-compute[74788]:       <listen type='address' address='0.0.0.0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </graphics>
Nov 08 15:16:05 user nova-compute[74788]:     <audio id='1' type='none'/>
Nov 08 15:16:05 user nova-compute[74788]:     <video>
Nov 08 15:16:05 user nova-compute[74788]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='video0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </video>
Nov 08 15:16:05 user nova-compute[74788]:     <memballoon model='virtio'>
Nov 08 15:16:05 user nova-compute[74788]:       <stats period='10'/>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='balloon0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:05 user nova-compute[74788]:     <rng model='virtio'>
Nov 08 15:16:05 user nova-compute[74788]:       <backend model='random'>/dev/urandom</backend>
Nov 08 15:16:05 user nova-compute[74788]:       <alias name='rng0'/>
Nov 08 15:16:05 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 15:16:05 user nova-compute[74788]:     </rng>
Nov 08 15:16:05 user nova-compute[74788]:   </devices>
Nov 08 15:16:05 user nova-compute[74788]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 15:16:05 user nova-compute[74788]:     <label>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</label>
Nov 08 15:16:05 user nova-compute[74788]:     <imagelabel>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</imagelabel>
Nov 08 15:16:05 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:05 user nova-compute[74788]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 15:16:05 user nova-compute[74788]:     <label>+64055:+108</label>
Nov 08 15:16:05 user nova-compute[74788]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 15:16:05 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:05 user nova-compute[74788]: </domain>
Nov 08 15:16:05 user nova-compute[74788]:  {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 15:16:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully detached device tapddb63fbc-04 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the persistent domain config.
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] (1/8): Attempting to detach device tapddb63fbc-04 with device alias net1 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] detach device xml: <interface type="ethernet">
Nov 08 15:16:05 user nova-compute[74788]:   <mac address="fa:16:3e:ce:c0:46"/>
Nov 08 15:16:05 user nova-compute[74788]:   <model type="virtio"/>
Nov 08 15:16:05 user nova-compute[74788]:   <mtu size="1442"/>
Nov 08 15:16:05 user nova-compute[74788]:   <target dev="tapddb63fbc-04"/>
Nov 08 15:16:05 user nova-compute[74788]: </interface>
Nov 08 15:16:05 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc5ef98-a32b-4cdc-9812-65afba3c1b31 tempest-VolumesAssistedSnapshotsTest-1958280288 tempest-VolumesAssistedSnapshotsTest-1958280288-project-admin] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.359s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --login" returned: 0 in 0.150s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[048cd959-cbee-4b7e-a750-538dfe216277]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260]
Nov 08 15:16:05 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.126s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2274b148-7d40-44c9-85a6-ab783bee7c1c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2593eff-1748-4c12-8836-59d05bb56bc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:05 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.578s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc9ec5-2fff-4d7d-b908-1a108a3ca14d]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TApeyDuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 336592896 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Start waiting for the detach event from libvirt for device tapddb63fbc-04 with device alias net1 for instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-unplugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-unplugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:05 user nova-compute[74788]: WARNING nova.compute.manager [req-108699cd-0f62-481a-ab39-8bd4dd8e1a2e req-bfe371da-fd95-40ad-9dc5-281d3c7cb576 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-unplugged-ddb63fbc-0493-4e78-9191-a897435bfabb for instance with vm_state active and task_state None.
Nov 08 15:16:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 478150656 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.619s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== connect_volume: return (1621ms) {'type': 'block', 'scsi_wwn': '23038626266316564', 'path': '/dev/sdg'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038626266316564', 'path': '/dev/sdg'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.309s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:06 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 631242752 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da58ed-2c6a-45d2-ab67-2b25619d9da8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:06 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UblkdPma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee265db-0f19-4629-b05d-e8cfdb21ec3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added
Nov 08 15:16:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d579f-ed50-4fbd-b811-9f3ff1d176c6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32dff6b-121a-4988-975e-7b5db306eb19]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255ee9e-0e86-4902-8077-0b14d4c7047c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojykunta'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e44d3-c889-4cb2-b0a4-785b120d777f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd288092-bf8d-43cd-a9a7-902196048b39]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:06 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0e5e0-10f9-41bc-9081-d69415e22ca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:16:06 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[efda8526-4d68-4d25-ac64-d995ed941188]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca5af5-8a58-421f-a21d-333355edb8e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:07 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3a0a1-f22f-413b-9e6a-9a06055a2c31]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 958398464 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== connect_volume: return (1832ms) {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdj'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdj'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.467s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:08 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:08 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'flavor' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3399df3-9efd-4e9f-80a9-e5424899f991]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:08 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be5c084-67a6-4f4f-8de6-29a23bda510b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b] added
Nov 08 15:16:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:16:08 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:08 user nova-compute[74788]:   <source dev="/dev/sdj"/>
Nov 08 15:16:08 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:16:08 user nova-compute[74788]:   <serial>edb139de-2a58-465f-8eb8-607ab11ae980</serial>
Nov 08 15:16:08 user nova-compute[74788]: </disk>
Nov 08 15:16:08 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[263bd838-2687-4b2c-8427-b56e0ed549c1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59774fb-5de9-4677-b39c-ff04568ebfba]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UblkdPma {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UblkdPma" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd6c806-85ce-4219-9d2b-6f6191b2436e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UblkdPma'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e337de-01f8-41c1-870a-7578aaea4404]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:08 user nova-compute[74788]: WARNING nova.compute.manager [req-5acb0eb9-0e2d-4a2b-903a-94411321b69a req-cb78c606-79c1-4908-88ba-3bdb52c9338c service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-ddb63fbc-0493-4e78-9191-a897435bfabb for instance with vm_state active and task_state None.
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[78144e86-c6fb-45ed-903a-fbfac557bf35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:08 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:08 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No VIF found with MAC fa:16:3e:31:6b:13, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a489dd38-2a0e-4936-a9b7-0cefc7af25cb tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.051s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --login" returned: 0 in 1.186s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ac014-4d2d-4a31-a4d6-7ab51dd3696b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260]
Nov 08 15:16:09 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.133s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bc547-9324-4b8c-80ac-d4cc94681cc8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a2416c-09f2-4ca9-8d00-57248e5c53b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:09 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.611s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a85f0d-8da4-4927-954d-e05156f46404]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UblkdPma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.642s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== connect_volume: return (4109ms) {'type': 'block', 'scsi_wwn': '26430666636386332', 'path': '/dev/sdk'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430666636386332', 'path': '/dev/sdk'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.166s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5822735-529c-4fe1-ba59-7bea81c87dca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:16:10 user nova-compute[74788]: No targets found.
Nov 08 15:16:10 user nova-compute[74788]: iSNS:
Nov 08 15:16:10 user nova-compute[74788]: No targets found.
Nov 08 15:16:10 user nova-compute[74788]: STATIC:
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:16:10 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:10 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:10 user nova-compute[74788]: FIRMWARE:
Nov 08 15:16:10 user nova-compute[74788]: No targets found.
Nov 08 15:16:10 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:16:10 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:16:10 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1fd12-d9ca-4d6d-9dbc-d9725688136a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlneyMUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:10 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cce9f3-1df1-430b-b111-0fdce5d9dbc3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:10 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:10 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758576440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3'): ({'sde'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Removing single pathed devices sde {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ba89f-937c-4b6b-b2f4-c2557dafe465]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2483c383-5af7-4c29-b769-6526afdd15bb]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Flushing IO for device /dev/sde {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecdfd5e-f0d0-468b-8421-ad1c9caf373a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f643131-40c2-4fa4-8f8e-e524bd8a82e4]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39128b4-772c-45b2-bb05-2ff533d17aba]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[016e55b4-5387-4d9e-8561-0b2504fc6356]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]
Nov 08 15:16:11 user nova-compute[74788]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d7798-7ea1-45cb-a46b-1d607495d2f4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== disconnect_volume: return (2537ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.295s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:11 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:11 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef372d8-22dd-4dcc-a7cf-c69153785058]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:11 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45dc3af-04ac-4931-9807-5ee11655870b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113] added
Nov 08 15:16:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085', 'serial'} {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: removing Cinder connection for volume e75ebf1b-dff4-4520-83b3-0316ba582fa3 {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe68159c-a4f1-41da-9b6a-0f74e65d3219]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab0871-db04-487e-875c-47d903dea57b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VlneyMUJ {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VlneyMUJ" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f390330-3568-4a21-8258-810db86ebc5b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VlneyMUJ'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbc202-cf9f-46b9-8bf4-c3cf651cf35e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09680ca-e5a3-48ae-bddd-6309aca6de25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:11 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Stashing vm_state: active {{(pid=74788) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:11 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:16:11 user nova-compute[74788]: INFO nova.compute.claims [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Claim successful on node user
Nov 08 15:16:11 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating resource usage from migration f92cff73-04ac-4f68-9ee5-9d18ef237e54
Nov 08 15:16:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.493s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:12 user nova-compute[74788]: INFO nova.compute.manager [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Migrating
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:12 user nova-compute[74788]: INFO nova.compute.rpcapi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --login" returned: 0 in 0.993s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e6747-51cc-4641-b5bd-4a218871e4ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260]
Nov 08 15:16:12 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae2001-6ed1-496b-b432-0ef032ee3d7d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef45b03-7534-423c-b6a1-89fa5d1b8bbd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:12 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.278s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.267s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c099a8e-303c-4a99-9c7e-886c80b72179]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlneyMUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Starting migrate_disk_and_power_off {{(pid=74788) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:13 user nova-compute[74788]: WARNING nova.compute.manager [req-3396398c-e663-4b27-9307-2dd4b63d723d req-44c925d3-41f4-4081-902b-6bfa1a900fd4 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state resize_migrating.
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: Updating volume e75ebf1b-dff4-4520-83b3-0316ba582fa3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "nLaQjIpb", "auth_password": "2gnFb38OCfZuaD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "c6eedca6-20a0-493c-894f-8376631a2085"}, "status": "reserved", "instance": "3e877b14-1461-4307-8bc9-363e1efaaa94", "attached_at": "", "detached_at": "", "volume_id": "c6eedca6-20a0-493c-894f-8376631a2085", "serial": "c6eedca6-20a0-493c-894f-8376631a2085"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085', 'no_device': None, 'attachment_id': 'cebe5ef1-47d3-4c02-a34c-2924f52b2060'} {{(pid=74788) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-68783ee0-0ff1-4350-8add-11d73639a025 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 42.518s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.572s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== connect_volume: return (2866ms) {'type': 'block', 'scsi_wwn': '23435316337396138', 'path': '/dev/sde'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435316337396138', 'path': '/dev/sde'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lazy-loading 'pci_devices' on Instance uuid b89bfc12-601f-4fde-9d1f-3cc99469e9b8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance destroyed successfully.
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:16:13 user nova-compute[74788]:   <uuid>b89bfc12-601f-4fde-9d1f-3cc99469e9b8</uuid>
Nov 08 15:16:13 user nova-compute[74788]:   <name>instance-00000009</name>
Nov 08 15:16:13 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:16:13 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:16:13 user nova-compute[74788]:   <metadata>
Nov 08 15:16:13 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:13 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:name>tempest-device-tagging-server-535354897</nova:name>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:16:04</nova:creationTime>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:16:13 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:13 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:owner>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:user uuid="3908028027ad4e5c9dc89c44c467538e">tempest-TaggedBootDevicesTest-1143317820-project-member</nova:user>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:project uuid="ab888621e1234bd480d99e82e1725ee3">tempest-TaggedBootDevicesTest-1143317820</nova:project>
Nov 08 15:16:13 user nova-compute[74788]:       </nova:owner>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:13 user nova-compute[74788]:       <nova:ports>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="15dda27b-28c1-4a9d-a0c2-0e2f99e5e584">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="e45635a9-2ce7-43c2-aad5-bb088282bfdf">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="e2527fe3-33e1-4798-8e1a-71f05e294af9">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="278b75c7-5eb7-4720-b102-da322c43d942">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="ea7473f4-3974-4b51-ba35-01c2b5bbb63d">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:         <nova:port uuid="8fe5c07a-db64-46d0-92d1-789fe668bfb7">
Nov 08 15:16:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 15:16:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:13 user nova-compute[74788]:       </nova:ports>
Nov 08 15:16:13 user nova-compute[74788]:     </nova:instance>
Nov 08 15:16:13 user nova-compute[74788]:   </metadata>
Nov 08 15:16:13 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:16:13 user nova-compute[74788]:     <system>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="serial">b89bfc12-601f-4fde-9d1f-3cc99469e9b8</entry>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="uuid">b89bfc12-601f-4fde-9d1f-3cc99469e9b8</entry>
Nov 08 15:16:13 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:16:13 user nova-compute[74788]:     </system>
Nov 08 15:16:13 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:13 user nova-compute[74788]:   <os>
Nov 08 15:16:13 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:16:13 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:16:13 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:16:13 user nova-compute[74788]:   </os>
Nov 08 15:16:13 user nova-compute[74788]:   <features>
Nov 08 15:16:13 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:13 user nova-compute[74788]:     <apic/>
Nov 08 15:16:13 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:16:13 user nova-compute[74788]:   </features>
Nov 08 15:16:13 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:16:13 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:16:13 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:16:13 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:16:13 user nova-compute[74788]:   </clock>
Nov 08 15:16:13 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:16:13 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:16:13 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:16:13 user nova-compute[74788]:   </cpu>
Nov 08 15:16:13 user nova-compute[74788]:   <devices>
Nov 08 15:16:13 user nova-compute[74788]:     <disk type="file" device="cdrom">
Nov 08 15:16:13 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 15:16:13 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/disk.config"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="hda" bus="ide"/>
Nov 08 15:16:13 user nova-compute[74788]:     </disk>
Nov 08 15:16:13 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:13 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:13 user nova-compute[74788]:       <source dev="/dev/sdg"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <serial>0c500d05-0bfc-42e7-9c57-0507d9e4ece4</serial>
Nov 08 15:16:13 user nova-compute[74788]:     </disk>
Nov 08 15:16:13 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:13 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:13 user nova-compute[74788]:       <source dev="/dev/sdk"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <serial>55d3fdfe-f44b-4e17-8475-e195b5312b3b</serial>
Nov 08 15:16:13 user nova-compute[74788]:     </disk>
Nov 08 15:16:13 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:13 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:13 user nova-compute[74788]:       <source dev="/dev/sde"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="vdc" bus="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <serial>d066e3ee-9f47-4bd7-b38a-6162bea94113</serial>
Nov 08 15:16:13 user nova-compute[74788]:     </disk>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:05:88:31"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tap487bbfb2-8b"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:97:ed:48"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tap15dda27b-28"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:4c:cd:15"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tape45635a9-2c"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:b3:2b:6c"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tape2527fe3-33"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:7c:b6:35"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tap278b75c7-5e"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:2b:46:00"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tapea7473f4-39"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:13 user nova-compute[74788]:       <mac address="fa:16:3e:0e:74:12"/>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:13 user nova-compute[74788]:       <target dev="tap8fe5c07a-db"/>
Nov 08 15:16:13 user nova-compute[74788]:     </interface>
Nov 08 15:16:13 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:16:13 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/console.log" append="off"/>
Nov 08 15:16:13 user nova-compute[74788]:     </serial>
Nov 08 15:16:13 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:16:13 user nova-compute[74788]:     <video>
Nov 08 15:16:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:13 user nova-compute[74788]:     </video>
Nov 08 15:16:13 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:16:13 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:16:13 user nova-compute[74788]:     </rng>
Nov 08 15:16:13 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:16:13 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:16:13 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:16:13 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:13 user nova-compute[74788]:   </devices>
Nov 08 15:16:13 user nova-compute[74788]: </domain>
Nov 08 15:16:13 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210c398c-b5, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76686883-d09f-42bd-8e3f-0b9856f434ac) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2a69ca3-6843-5c16-b3f8-eae96bb779df', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: INFO os_vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:13 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap487bbfb2-8b, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap487bbfb2-8b, col_values=(('qos', UUID('61917fe0-a3a3-4b29-b2d2-80598b98eecc')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap487bbfb2-8b, col_values=(('external_ids', {'iface-id': '487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:88:31', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a729597-463c-4fd6-abb2-c57bd2ed6456]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:16:13 user nova-compute[74788]: No targets found.
Nov 08 15:16:13 user nova-compute[74788]: iSNS:
Nov 08 15:16:13 user nova-compute[74788]: No targets found.
Nov 08 15:16:13 user nova-compute[74788]: STATIC:
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:16:13 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:13 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:13 user nova-compute[74788]: FIRMWARE:
Nov 08 15:16:13 user nova-compute[74788]: No targets found.
Nov 08 15:16:13 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:16:13 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:16:13 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b')
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e5bd0-af4f-4797-8600-807dfaf42c14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2075a406-fe29-53f9-8aad-8949f2c8ca55', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15dda27b-28, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15dda27b-28, col_values=(('qos', UUID('4c68794c-a7ac-4b41-a6ab-1d8b59b4fbd5')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15dda27b-28, col_values=(('external_ids', {'iface-id': '15dda27b-28c1-4a9d-a0c2-0e2f99e5e584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:ed:48', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[16695992-1758-4528-bfa0-22ac82373fd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:13 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:13 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758500700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980'): ({'sdj'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Removing single pathed devices sdj {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e53964-0b3d-49e9-ae55-99b951d19ba1]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28')
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '182dc6f1-022e-5285-bd35-550f750fa71f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca49de-5d69-4183-b26b-d6ca56f23ece]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flushing IO for device /dev/sdj {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3628d62f-59e3-4440-b96e-4c121560566e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape45635a9-2c, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape45635a9-2c, col_values=(('qos', UUID('d9db543a-7ff8-4d8f-a7a2-1985b9be421d')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape45635a9-2c, col_values=(('external_ids', {'iface-id': 'e45635a9-2ce7-43c2-aad5-bb088282bfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:cd:15', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c94c4a-4fd5-478f-8d60-e436ad60a5df]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] SCSI volumes sdj have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c')
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28453ad9-af7c-5649-91d3-1df07fe88f39', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b3dc0-e72d-4b2b-96b6-a8eaf5de8394]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2527fe3-33, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2527fe3-33, col_values=(('qos', UUID('379a72c2-e877-413d-bef7-fc41d80708cf')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2527fe3-33, col_values=(('external_ids', {'iface-id': 'e2527fe3-33e1-4798-8e1a-71f05e294af9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2b:6c', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7c631-423c-4d5f-beb5-b6bd1283c05a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:16:14 user nova-compute[74788]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33')
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ca6c8c1-a56e-5636-8a80-f53029bb8b90', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb6a65-c97f-48ac-a64c-d5608431b4f2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== disconnect_volume: return (427ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap278b75c7-5e, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap278b75c7-5e, col_values=(('qos', UUID('b86de64e-5244-4364-b75d-4fd976bdebc2')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap278b75c7-5e, col_values=(('external_ids', {'iface-id': '278b75c7-5eb7-4720-b102-da322c43d942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b6:35', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e')
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a95eac-81df-5948-93d1-eaa0571e5e53', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea7473f4-39, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea7473f4-39, col_values=(('qos', UUID('28139e3e-ef02-4913-a5fc-cfc162f580a0')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea7473f4-39, col_values=(('external_ids', {'iface-id': 'ea7473f4-3974-4b51-ba35-01c2b5bbb63d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:46:00', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39')
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d3e2aef-36d7-57b8-9429-251cad2065d1', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.utils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[534251f5-1a48-49b5-afad-8305253696f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ba5c0-273d-491d-84ad-db66584b0cf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a5ea8-801b-4c58-ade2-0e78006644f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ad1f4-daa2-4823-ba31-4543894eb66d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_resize/disk /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:14 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:16:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fac3c2-a5a5-4e49-9fe7-dbfb4b3bf92c]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe5c07a-db, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fe5c07a-db, col_values=(('qos', UUID('494cbaf7-3185-4626-870c-3a26b38e6105')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fe5c07a-db, col_values=(('external_ids', {'iface-id': '8fe5c07a-db64-46d0-92d1-789fe668bfb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:74:12', 'vm-uuid': 'b89bfc12-601f-4fde-9d1f-3cc99469e9b8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG os_brick.utils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:14 user nova-compute[74788]: INFO os_vif [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db')
Nov 08 15:16:14 user nova-compute[74788]: INFO nova.compute.manager [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Swapping volume c6eedca6-20a0-493c-894f-8376631a2085 for e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] No BDM found with device name hda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] No VIF found with MAC fa:16:3e:05:88:31, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] No VIF found with MAC fa:16:3e:7c:b6:35, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Using config drive
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "cp -r /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_resize/disk /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk" returned: 0 in 0.324s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_resize/disk.info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk.info {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "cp -r /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_resize/disk.info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk.info" returned: 0 in 0.036s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Creating config drive at /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/disk.config
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp60ry2tvy {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp60ry2tvy" returned: 0 in 0.057s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-48b07831-e290-40ac-9363-fbd606706f0a req-fd3c3ad4-3e6a-4881-a5d3-a56baac7a607 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event volume-reimaged-2b5251fd-3275-45d8-994c-180882761901 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-48b07831-e290-40ac-9363-fbd606706f0a req-fd3c3ad4-3e6a-4881-a5d3-a56baac7a607 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-48b07831-e290-40ac-9363-fbd606706f0a req-fd3c3ad4-3e6a-4881-a5d3-a56baac7a607 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-48b07831-e290-40ac-9363-fbd606706f0a req-fd3c3ad4-3e6a-4881-a5d3-a56baac7a607 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-48b07831-e290-40ac-9363-fbd606706f0a req-fd3c3ad4-3e6a-4881-a5d3-a56baac7a607 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Processing event volume-reimaged-2b5251fd-3275-45d8-994c-180882761901 {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance event wait completed in 42 seconds for volume-reimaged {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:15 user nova-compute[74788]: WARNING nova.compute.manager [req-c32d26e7-100f-4396-b419-6603bcc4db65 req-f9fad49e-1170-4bfb-af20-d870ab1c38d5 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state resize_migrating.
Nov 08 15:16:15 user nova-compute[74788]: INFO nova.virt.block_device [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Booting with volume 2b5251fd-3275-45d8-994c-180882761901 at /dev/vda
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.utils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0960f6fc-69b8-4cd2-bc30-b42241ea9daa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56ba025-dbbb-45f9-8b6d-7c04619c1c9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc4a117-6d0a-4531-b6ae-818614749c8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d76e3b-7469-4234-9a64-357a80caf75f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:15 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:16:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[765dde14-6b56-4ce2-af7c-f7aacdc92036]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG os_brick.utils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:15 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating existing volume attachment record: d9a63d55-23b4-4d7d-b922-c09c60905983 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Port 210c398c-b530-47f9-9e1b-e8d1b41f6389 binding to destination host user is already ACTIVE {{(pid=74788) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:16:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:17 user nova-compute[74788]: WARNING nova.compute.manager [req-9aa06215-2588-41ba-ac14-35962d6b55a1 req-2b7e1750-bad8-4377-b296-186dca4d06e3 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba for instance with vm_state building and task_state spawning.
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG nova.compute.manager [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG nova.compute.manager [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:18 user nova-compute[74788]: WARNING nova.compute.manager [req-75b0b6d5-0fc8-47d9-a1ec-fe8019614e50 req-727d76ab-5c7d-47be-960b-34b1885b08b2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 for instance with vm_state building and task_state spawning.
Nov 08 15:16:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.utils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa4f31-965c-4110-a422-6c49f270451f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1669689a-033b-4120-96a2-e9b39eaf3d59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc077884-d9c9-491d-8aed-0d09c1a13536]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9c8e4-e00d-44aa-aa56-567d36b33529]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:16:18 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:16:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8299087d-33e9-4a6f-af18-278cb70be090]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG os_brick.utils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:19 user nova-compute[74788]: WARNING nova.compute.manager [req-91282ec3-5af7-484c-a6d9-7e895fc40ece req-3b665c8c-efee-40f3-ba3d-58847fafe2e2 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 for instance with vm_state building and task_state spawning.
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:20 user nova-compute[74788]: WARNING nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 for instance with vm_state building and task_state spawning.
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:20 user nova-compute[74788]: WARNING nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 for instance with vm_state building and task_state spawning.
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:20 user nova-compute[74788]: WARNING nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 for instance with vm_state building and task_state spawning.
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:20 user nova-compute[74788]: WARNING nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d for instance with vm_state building and task_state spawning.
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:20 user nova-compute[74788]: WARNING nova.compute.manager [req-5754ccdb-f1e0-4597-a2ab-9d6884a2863b req-989304ec-72d7-4f7c-847f-8bd6f9ec2c57 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d for instance with vm_state building and task_state spawning.
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:21 user nova-compute[74788]: WARNING nova.compute.manager [req-51faf56d-03c7-4a77-9bb7-513c5e993084 req-5a18a69c-e448-47ff-8877-5c5ded648852 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 for instance with vm_state building and task_state spawning.
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:16:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance spawned successfully.
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:21 user nova-compute[74788]: INFO nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Took 16.75 seconds to spawn the instance on the hypervisor.
Nov 08 15:16:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:16:21 user nova-compute[74788]: INFO nova.compute.manager [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Took 172.66 seconds to build instance.
Nov 08 15:16:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c3525bc4-8d82-4e03-b4ab-551d65676bb1 tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 172.797s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Waiting for libvirt event about the detach of device tapddb63fbc-04 with device alias net1 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 is timed out.
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 15:16:25 user nova-compute[74788]:   <name>instance-00000005</name>
Nov 08 15:16:25 user nova-compute[74788]:   <uuid>9b540dd4-ac0f-41a2-941a-a7dd519d2922</uuid>
Nov 08 15:16:25 user nova-compute[74788]:   <metadata>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:25 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:14:04</nova:creationTime>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:25 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:25 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:25 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:port uuid="ddb63fbc-0493-4e78-9191-a897435bfabb">
Nov 08 15:16:25 user nova-compute[74788]:       <nova:ip type="fixed" address="10.10.10.252" ipVersion="4"/>
Nov 08 15:16:25 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:25 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:25 user nova-compute[74788]:   </metadata>
Nov 08 15:16:25 user nova-compute[74788]:   <memory unit='KiB'>524288</memory>
Nov 08 15:16:25 user nova-compute[74788]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 15:16:25 user nova-compute[74788]:   <vcpu placement='static'>1</vcpu>
Nov 08 15:16:25 user nova-compute[74788]:   <resource>
Nov 08 15:16:25 user nova-compute[74788]:     <partition>/machine</partition>
Nov 08 15:16:25 user nova-compute[74788]:   </resource>
Nov 08 15:16:25 user nova-compute[74788]:   <sysinfo type='smbios'>
Nov 08 15:16:25 user nova-compute[74788]:     <system>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='version'>0.0.0</entry>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='serial'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='uuid'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:25 user nova-compute[74788]:       <entry name='family'>Virtual Machine</entry>
Nov 08 15:16:25 user nova-compute[74788]:     </system>
Nov 08 15:16:25 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:25 user nova-compute[74788]:   <os>
Nov 08 15:16:25 user nova-compute[74788]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 15:16:25 user nova-compute[74788]:     <boot dev='hd'/>
Nov 08 15:16:25 user nova-compute[74788]:     <smbios mode='sysinfo'/>
Nov 08 15:16:25 user nova-compute[74788]:   </os>
Nov 08 15:16:25 user nova-compute[74788]:   <features>
Nov 08 15:16:25 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:25 user nova-compute[74788]:     <apic/>
Nov 08 15:16:25 user nova-compute[74788]:     <vmcoreinfo state='on'/>
Nov 08 15:16:25 user nova-compute[74788]:   </features>
Nov 08 15:16:25 user nova-compute[74788]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 15:16:25 user nova-compute[74788]:     <model fallback='forbid'>Nehalem</model>
Nov 08 15:16:25 user nova-compute[74788]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 15:16:25 user nova-compute[74788]:     <feature policy='require' name='vme'/>
Nov 08 15:16:25 user nova-compute[74788]:     <feature policy='require' name='x2apic'/>
Nov 08 15:16:25 user nova-compute[74788]:     <feature policy='require' name='hypervisor'/>
Nov 08 15:16:25 user nova-compute[74788]:   </cpu>
Nov 08 15:16:25 user nova-compute[74788]:   <clock offset='utc'>
Nov 08 15:16:25 user nova-compute[74788]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 15:16:25 user nova-compute[74788]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 15:16:25 user nova-compute[74788]:     <timer name='hpet' present='no'/>
Nov 08 15:16:25 user nova-compute[74788]:   </clock>
Nov 08 15:16:25 user nova-compute[74788]:   <on_poweroff>destroy</on_poweroff>
Nov 08 15:16:25 user nova-compute[74788]:   <on_reboot>restart</on_reboot>
Nov 08 15:16:25 user nova-compute[74788]:   <on_crash>destroy</on_crash>
Nov 08 15:16:25 user nova-compute[74788]:   <devices>
Nov 08 15:16:25 user nova-compute[74788]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 15:16:25 user nova-compute[74788]:     <disk type='file' device='disk'>
Nov 08 15:16:25 user nova-compute[74788]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 15:16:25 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk' index='2'/>
Nov 08 15:16:25 user nova-compute[74788]:       <backingStore type='file' index='3'>
Nov 08 15:16:25 user nova-compute[74788]:         <format type='raw'/>
Nov 08 15:16:25 user nova-compute[74788]:         <source file='/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9'/>
Nov 08 15:16:25 user nova-compute[74788]:         <backingStore/>
Nov 08 15:16:25 user nova-compute[74788]:       </backingStore>
Nov 08 15:16:25 user nova-compute[74788]:       <target dev='vda' bus='virtio'/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='virtio-disk0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </disk>
Nov 08 15:16:25 user nova-compute[74788]:     <disk type='file' device='cdrom'>
Nov 08 15:16:25 user nova-compute[74788]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 15:16:25 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config' index='1'/>
Nov 08 15:16:25 user nova-compute[74788]:       <backingStore/>
Nov 08 15:16:25 user nova-compute[74788]:       <target dev='hda' bus='ide'/>
Nov 08 15:16:25 user nova-compute[74788]:       <readonly/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='ide0-0-0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </disk>
Nov 08 15:16:25 user nova-compute[74788]:     <controller type='usb' index='0' model='none'>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='usb'/>
Nov 08 15:16:25 user nova-compute[74788]:     </controller>
Nov 08 15:16:25 user nova-compute[74788]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='pci.0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </controller>
Nov 08 15:16:25 user nova-compute[74788]:     <controller type='ide' index='0'>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='ide'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 15:16:25 user nova-compute[74788]:     </controller>
Nov 08 15:16:25 user nova-compute[74788]:     <interface type='ethernet'>
Nov 08 15:16:25 user nova-compute[74788]:       <mac address='fa:16:3e:3e:9d:5a'/>
Nov 08 15:16:25 user nova-compute[74788]:       <target dev='tap2d460349-ac'/>
Nov 08 15:16:25 user nova-compute[74788]:       <model type='virtio'/>
Nov 08 15:16:25 user nova-compute[74788]:       <mtu size='1442'/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='net0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </interface>
Nov 08 15:16:25 user nova-compute[74788]:     <serial type='pty'>
Nov 08 15:16:25 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:25 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:25 user nova-compute[74788]:       <target type='isa-serial' port='0'>
Nov 08 15:16:25 user nova-compute[74788]:         <model name='isa-serial'/>
Nov 08 15:16:25 user nova-compute[74788]:       </target>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </serial>
Nov 08 15:16:25 user nova-compute[74788]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 15:16:25 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:25 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:25 user nova-compute[74788]:       <target type='serial' port='0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </console>
Nov 08 15:16:25 user nova-compute[74788]:     <input type='mouse' bus='ps2'>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='input0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </input>
Nov 08 15:16:25 user nova-compute[74788]:     <input type='keyboard' bus='ps2'>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='input1'/>
Nov 08 15:16:25 user nova-compute[74788]:     </input>
Nov 08 15:16:25 user nova-compute[74788]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 15:16:25 user nova-compute[74788]:       <listen type='address' address='0.0.0.0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </graphics>
Nov 08 15:16:25 user nova-compute[74788]:     <audio id='1' type='none'/>
Nov 08 15:16:25 user nova-compute[74788]:     <video>
Nov 08 15:16:25 user nova-compute[74788]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='video0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </video>
Nov 08 15:16:25 user nova-compute[74788]:     <memballoon model='virtio'>
Nov 08 15:16:25 user nova-compute[74788]:       <stats period='10'/>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='balloon0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:25 user nova-compute[74788]:     <rng model='virtio'>
Nov 08 15:16:25 user nova-compute[74788]:       <backend model='random'>/dev/urandom</backend>
Nov 08 15:16:25 user nova-compute[74788]:       <alias name='rng0'/>
Nov 08 15:16:25 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 15:16:25 user nova-compute[74788]:     </rng>
Nov 08 15:16:25 user nova-compute[74788]:   </devices>
Nov 08 15:16:25 user nova-compute[74788]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 15:16:25 user nova-compute[74788]:     <label>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</label>
Nov 08 15:16:25 user nova-compute[74788]:     <imagelabel>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</imagelabel>
Nov 08 15:16:25 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:25 user nova-compute[74788]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 15:16:25 user nova-compute[74788]:     <label>+64055:+108</label>
Nov 08 15:16:25 user nova-compute[74788]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 15:16:25 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:25 user nova-compute[74788]: </domain>
Nov 08 15:16:25 user nova-compute[74788]:  {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 15:16:25 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully detached device tapddb63fbc-04 from instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 from the live domain config.
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG os_vif [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddb63fbc-04, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8435bf7c-6e77-4b96-9a3e-c1c757ecaf1d) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:25 user nova-compute[74788]: INFO os_vif [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04')
Nov 08 15:16:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:25 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:16:25</nova:creationTime>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:25 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:25 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:25 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:25 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:25 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:25 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:25 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:25 user nova-compute[74788]:  {{(pid=74788) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-deleted-ddb63fbc-0493-4e78-9191-a897435bfabb {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:26 user nova-compute[74788]: INFO nova.compute.manager [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Neutron deleted interface ddb63fbc-0493-4e78-9191-a897435bfabb; detaching it from the instance and deleting it from the info cache
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.objects.instance [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Lazy-loading 'system_metadata' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.objects.instance [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Lazy-loading 'flavor' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.objects.base [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Object Instance<9b540dd4-ac0f-41a2-941a-a7dd519d2922> lazy-loaded attributes: system_metadata,flavor {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 15:16:26 user nova-compute[74788]:   <name>instance-00000005</name>
Nov 08 15:16:26 user nova-compute[74788]:   <uuid>9b540dd4-ac0f-41a2-941a-a7dd519d2922</uuid>
Nov 08 15:16:26 user nova-compute[74788]:   <metadata>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:26 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:16:25</nova:creationTime>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:26 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:26 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:26 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:26 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:26 user nova-compute[74788]:   </metadata>
Nov 08 15:16:26 user nova-compute[74788]:   <memory unit='KiB'>524288</memory>
Nov 08 15:16:26 user nova-compute[74788]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 15:16:26 user nova-compute[74788]:   <vcpu placement='static'>1</vcpu>
Nov 08 15:16:26 user nova-compute[74788]:   <resource>
Nov 08 15:16:26 user nova-compute[74788]:     <partition>/machine</partition>
Nov 08 15:16:26 user nova-compute[74788]:   </resource>
Nov 08 15:16:26 user nova-compute[74788]:   <sysinfo type='smbios'>
Nov 08 15:16:26 user nova-compute[74788]:     <system>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='version'>0.0.0</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='serial'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='uuid'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='family'>Virtual Machine</entry>
Nov 08 15:16:26 user nova-compute[74788]:     </system>
Nov 08 15:16:26 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:26 user nova-compute[74788]:   <os>
Nov 08 15:16:26 user nova-compute[74788]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 15:16:26 user nova-compute[74788]:     <boot dev='hd'/>
Nov 08 15:16:26 user nova-compute[74788]:     <smbios mode='sysinfo'/>
Nov 08 15:16:26 user nova-compute[74788]:   </os>
Nov 08 15:16:26 user nova-compute[74788]:   <features>
Nov 08 15:16:26 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:26 user nova-compute[74788]:     <apic/>
Nov 08 15:16:26 user nova-compute[74788]:     <vmcoreinfo state='on'/>
Nov 08 15:16:26 user nova-compute[74788]:   </features>
Nov 08 15:16:26 user nova-compute[74788]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 15:16:26 user nova-compute[74788]:     <model fallback='forbid'>Nehalem</model>
Nov 08 15:16:26 user nova-compute[74788]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='vme'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='x2apic'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='hypervisor'/>
Nov 08 15:16:26 user nova-compute[74788]:   </cpu>
Nov 08 15:16:26 user nova-compute[74788]:   <clock offset='utc'>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='hpet' present='no'/>
Nov 08 15:16:26 user nova-compute[74788]:   </clock>
Nov 08 15:16:26 user nova-compute[74788]:   <on_poweroff>destroy</on_poweroff>
Nov 08 15:16:26 user nova-compute[74788]:   <on_reboot>restart</on_reboot>
Nov 08 15:16:26 user nova-compute[74788]:   <on_crash>destroy</on_crash>
Nov 08 15:16:26 user nova-compute[74788]:   <devices>
Nov 08 15:16:26 user nova-compute[74788]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 15:16:26 user nova-compute[74788]:     <disk type='file' device='disk'>
Nov 08 15:16:26 user nova-compute[74788]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 15:16:26 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk' index='2'/>
Nov 08 15:16:26 user nova-compute[74788]:       <backingStore type='file' index='3'>
Nov 08 15:16:26 user nova-compute[74788]:         <format type='raw'/>
Nov 08 15:16:26 user nova-compute[74788]:         <source file='/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9'/>
Nov 08 15:16:26 user nova-compute[74788]:         <backingStore/>
Nov 08 15:16:26 user nova-compute[74788]:       </backingStore>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='vda' bus='virtio'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='virtio-disk0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </disk>
Nov 08 15:16:26 user nova-compute[74788]:     <disk type='file' device='cdrom'>
Nov 08 15:16:26 user nova-compute[74788]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 15:16:26 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config' index='1'/>
Nov 08 15:16:26 user nova-compute[74788]:       <backingStore/>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='hda' bus='ide'/>
Nov 08 15:16:26 user nova-compute[74788]:       <readonly/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='ide0-0-0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </disk>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='usb' index='0' model='none'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='usb'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='pci.0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='ide' index='0'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='ide'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <interface type='ethernet'>
Nov 08 15:16:26 user nova-compute[74788]:       <mac address='fa:16:3e:3e:9d:5a'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='tap2d460349-ac'/>
Nov 08 15:16:26 user nova-compute[74788]:       <model type='virtio'/>
Nov 08 15:16:26 user nova-compute[74788]:       <mtu size='1442'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='net0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </interface>
Nov 08 15:16:26 user nova-compute[74788]:     <serial type='pty'>
Nov 08 15:16:26 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:26 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target type='isa-serial' port='0'>
Nov 08 15:16:26 user nova-compute[74788]:         <model name='isa-serial'/>
Nov 08 15:16:26 user nova-compute[74788]:       </target>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </serial>
Nov 08 15:16:26 user nova-compute[74788]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 15:16:26 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:26 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target type='serial' port='0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </console>
Nov 08 15:16:26 user nova-compute[74788]:     <input type='mouse' bus='ps2'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='input0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </input>
Nov 08 15:16:26 user nova-compute[74788]:     <input type='keyboard' bus='ps2'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='input1'/>
Nov 08 15:16:26 user nova-compute[74788]:     </input>
Nov 08 15:16:26 user nova-compute[74788]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 15:16:26 user nova-compute[74788]:       <listen type='address' address='0.0.0.0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </graphics>
Nov 08 15:16:26 user nova-compute[74788]:     <audio id='1' type='none'/>
Nov 08 15:16:26 user nova-compute[74788]:     <video>
Nov 08 15:16:26 user nova-compute[74788]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='video0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </video>
Nov 08 15:16:26 user nova-compute[74788]:     <memballoon model='virtio'>
Nov 08 15:16:26 user nova-compute[74788]:       <stats period='10'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='balloon0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:26 user nova-compute[74788]:     <rng model='virtio'>
Nov 08 15:16:26 user nova-compute[74788]:       <backend model='random'>/dev/urandom</backend>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='rng0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </rng>
Nov 08 15:16:26 user nova-compute[74788]:   </devices>
Nov 08 15:16:26 user nova-compute[74788]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 15:16:26 user nova-compute[74788]:     <label>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</label>
Nov 08 15:16:26 user nova-compute[74788]:     <imagelabel>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</imagelabel>
Nov 08 15:16:26 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:26 user nova-compute[74788]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 15:16:26 user nova-compute[74788]:     <label>+64055:+108</label>
Nov 08 15:16:26 user nova-compute[74788]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 15:16:26 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:26 user nova-compute[74788]: </domain>
Nov 08 15:16:26 user nova-compute[74788]:  {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface> {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:c0:46"/><model type="virtio"/><mtu size="1442"/><target dev="tapddb63fbc-04"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 08 15:16:26 user nova-compute[74788]:   <name>instance-00000005</name>
Nov 08 15:16:26 user nova-compute[74788]:   <uuid>9b540dd4-ac0f-41a2-941a-a7dd519d2922</uuid>
Nov 08 15:16:26 user nova-compute[74788]:   <metadata>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:26 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:16:25</nova:creationTime>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:26 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:26 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:26 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:26 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:26 user nova-compute[74788]:   </metadata>
Nov 08 15:16:26 user nova-compute[74788]:   <memory unit='KiB'>524288</memory>
Nov 08 15:16:26 user nova-compute[74788]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 15:16:26 user nova-compute[74788]:   <vcpu placement='static'>1</vcpu>
Nov 08 15:16:26 user nova-compute[74788]:   <resource>
Nov 08 15:16:26 user nova-compute[74788]:     <partition>/machine</partition>
Nov 08 15:16:26 user nova-compute[74788]:   </resource>
Nov 08 15:16:26 user nova-compute[74788]:   <sysinfo type='smbios'>
Nov 08 15:16:26 user nova-compute[74788]:     <system>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='version'>0.0.0</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='serial'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='uuid'>9b540dd4-ac0f-41a2-941a-a7dd519d2922</entry>
Nov 08 15:16:26 user nova-compute[74788]:       <entry name='family'>Virtual Machine</entry>
Nov 08 15:16:26 user nova-compute[74788]:     </system>
Nov 08 15:16:26 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:26 user nova-compute[74788]:   <os>
Nov 08 15:16:26 user nova-compute[74788]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 15:16:26 user nova-compute[74788]:     <boot dev='hd'/>
Nov 08 15:16:26 user nova-compute[74788]:     <smbios mode='sysinfo'/>
Nov 08 15:16:26 user nova-compute[74788]:   </os>
Nov 08 15:16:26 user nova-compute[74788]:   <features>
Nov 08 15:16:26 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:26 user nova-compute[74788]:     <apic/>
Nov 08 15:16:26 user nova-compute[74788]:     <vmcoreinfo state='on'/>
Nov 08 15:16:26 user nova-compute[74788]:   </features>
Nov 08 15:16:26 user nova-compute[74788]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 15:16:26 user nova-compute[74788]:     <model fallback='forbid'>Nehalem</model>
Nov 08 15:16:26 user nova-compute[74788]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='vme'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='x2apic'/>
Nov 08 15:16:26 user nova-compute[74788]:     <feature policy='require' name='hypervisor'/>
Nov 08 15:16:26 user nova-compute[74788]:   </cpu>
Nov 08 15:16:26 user nova-compute[74788]:   <clock offset='utc'>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 15:16:26 user nova-compute[74788]:     <timer name='hpet' present='no'/>
Nov 08 15:16:26 user nova-compute[74788]:   </clock>
Nov 08 15:16:26 user nova-compute[74788]:   <on_poweroff>destroy</on_poweroff>
Nov 08 15:16:26 user nova-compute[74788]:   <on_reboot>restart</on_reboot>
Nov 08 15:16:26 user nova-compute[74788]:   <on_crash>destroy</on_crash>
Nov 08 15:16:26 user nova-compute[74788]:   <devices>
Nov 08 15:16:26 user nova-compute[74788]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 15:16:26 user nova-compute[74788]:     <disk type='file' device='disk'>
Nov 08 15:16:26 user nova-compute[74788]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 15:16:26 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk' index='2'/>
Nov 08 15:16:26 user nova-compute[74788]:       <backingStore type='file' index='3'>
Nov 08 15:16:26 user nova-compute[74788]:         <format type='raw'/>
Nov 08 15:16:26 user nova-compute[74788]:         <source file='/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9'/>
Nov 08 15:16:26 user nova-compute[74788]:         <backingStore/>
Nov 08 15:16:26 user nova-compute[74788]:       </backingStore>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='vda' bus='virtio'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='virtio-disk0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </disk>
Nov 08 15:16:26 user nova-compute[74788]:     <disk type='file' device='cdrom'>
Nov 08 15:16:26 user nova-compute[74788]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 15:16:26 user nova-compute[74788]:       <source file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk.config' index='1'/>
Nov 08 15:16:26 user nova-compute[74788]:       <backingStore/>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='hda' bus='ide'/>
Nov 08 15:16:26 user nova-compute[74788]:       <readonly/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='ide0-0-0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </disk>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='usb' index='0' model='none'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='usb'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='pci.0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <controller type='ide' index='0'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='ide'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 15:16:26 user nova-compute[74788]:     </controller>
Nov 08 15:16:26 user nova-compute[74788]:     <interface type='ethernet'>
Nov 08 15:16:26 user nova-compute[74788]:       <mac address='fa:16:3e:3e:9d:5a'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target dev='tap2d460349-ac'/>
Nov 08 15:16:26 user nova-compute[74788]:       <model type='virtio'/>
Nov 08 15:16:26 user nova-compute[74788]:       <mtu size='1442'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='net0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </interface>
Nov 08 15:16:26 user nova-compute[74788]:     <serial type='pty'>
Nov 08 15:16:26 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:26 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target type='isa-serial' port='0'>
Nov 08 15:16:26 user nova-compute[74788]:         <model name='isa-serial'/>
Nov 08 15:16:26 user nova-compute[74788]:       </target>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </serial>
Nov 08 15:16:26 user nova-compute[74788]:     <console type='pty' tty='/dev/pts/4'>
Nov 08 15:16:26 user nova-compute[74788]:       <source path='/dev/pts/4'/>
Nov 08 15:16:26 user nova-compute[74788]:       <log file='/opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/console.log' append='off'/>
Nov 08 15:16:26 user nova-compute[74788]:       <target type='serial' port='0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='serial0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </console>
Nov 08 15:16:26 user nova-compute[74788]:     <input type='mouse' bus='ps2'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='input0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </input>
Nov 08 15:16:26 user nova-compute[74788]:     <input type='keyboard' bus='ps2'>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='input1'/>
Nov 08 15:16:26 user nova-compute[74788]:     </input>
Nov 08 15:16:26 user nova-compute[74788]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 08 15:16:26 user nova-compute[74788]:       <listen type='address' address='0.0.0.0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </graphics>
Nov 08 15:16:26 user nova-compute[74788]:     <audio id='1' type='none'/>
Nov 08 15:16:26 user nova-compute[74788]:     <video>
Nov 08 15:16:26 user nova-compute[74788]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='video0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </video>
Nov 08 15:16:26 user nova-compute[74788]:     <memballoon model='virtio'>
Nov 08 15:16:26 user nova-compute[74788]:       <stats period='10'/>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='balloon0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:26 user nova-compute[74788]:     <rng model='virtio'>
Nov 08 15:16:26 user nova-compute[74788]:       <backend model='random'>/dev/urandom</backend>
Nov 08 15:16:26 user nova-compute[74788]:       <alias name='rng0'/>
Nov 08 15:16:26 user nova-compute[74788]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 15:16:26 user nova-compute[74788]:     </rng>
Nov 08 15:16:26 user nova-compute[74788]:   </devices>
Nov 08 15:16:26 user nova-compute[74788]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 15:16:26 user nova-compute[74788]:     <label>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</label>
Nov 08 15:16:26 user nova-compute[74788]:     <imagelabel>libvirt-9b540dd4-ac0f-41a2-941a-a7dd519d2922</imagelabel>
Nov 08 15:16:26 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:26 user nova-compute[74788]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 15:16:26 user nova-compute[74788]:     <label>+64055:+108</label>
Nov 08 15:16:26 user nova-compute[74788]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 15:16:26 user nova-compute[74788]:   </seclabel>
Nov 08 15:16:26 user nova-compute[74788]: </domain>
Nov 08 15:16:26 user nova-compute[74788]:  {{(pid=74788) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 15:16:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Detaching interface fa:16:3e:ce:c0:46 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapddb63fbc-04' not found.
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Converting VIF {"id": "ddb63fbc-0493-4e78-9191-a897435bfabb", "address": "fa:16:3e:ce:c0:46", "network": {"id": "47c57bcd-d060-4734-9c8a-50116288cfbc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-343887712", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb63fbc-04", "ovs_interfaceid": "ddb63fbc-0493-4e78-9191-a897435bfabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG os_vif [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddb63fbc-04, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:26 user nova-compute[74788]: INFO os_vif [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=ddb63fbc-0493-4e78-9191-a897435bfabb,network=Network(47c57bcd-d060-4734-9c8a-50116288cfbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb63fbc-04')
Nov 08 15:16:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [req-7ad24625-72f6-47bb-80c9-baf3f8e2059c req-5b306e74-4afd-4ca9-9833-9562fdd8c359 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:26 user nova-compute[74788]:   <nova:package version="0.0.0"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:name>tempest-device-tagging-server-1140230710</nova:name>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:creationTime>2023-11-08 15:16:26</nova:creationTime>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:flavor name="m1.tiny">
Nov 08 15:16:26 user nova-compute[74788]:     <nova:memory>512</nova:memory>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:disk>1</nova:disk>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:swap>0</nova:swap>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:flavor>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:user uuid="649cb7a8623d4a70933af2e4742921ce">tempest-TaggedAttachmentsTest-1767194789-project-member</nova:user>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:project uuid="ad0a360ac3974426b6f6aea8e48dcfb9">tempest-TaggedAttachmentsTest-1767194789</nova:project>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:owner>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:26 user nova-compute[74788]:   <nova:ports>
Nov 08 15:16:26 user nova-compute[74788]:     <nova:port uuid="2d460349-ac8e-41df-a62f-9b36089aa51f">
Nov 08 15:16:26 user nova-compute[74788]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:26 user nova-compute[74788]:     </nova:port>
Nov 08 15:16:26 user nova-compute[74788]:   </nova:ports>
Nov 08 15:16:26 user nova-compute[74788]: </nova:instance>
Nov 08 15:16:26 user nova-compute[74788]:  {{(pid=74788) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 15:16:27 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0ab65924-7ac2-4156-9d4f-31935cc740bb tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "interface-9b540dd4-ac0f-41a2-941a-a7dd519d2922-ddb63fbc-0493-4e78-9191-a897435bfabb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.979s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [{"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-9b540dd4-ac0f-41a2-941a-a7dd519d2922" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:31 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7780MB free_disk=25.590702056884766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Applying migration context for instance 4d4cedbd-4e31-4aad-a580-da6aded0134f as it has an incoming, in-progress migration f92cff73-04ac-4f68-9ee5-9d18ef237e54. Migration status is post-migrating {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 15:16:35 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating resource usage from migration f92cff73-04ac-4f68-9ee5-9d18ef237e54
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 5e2c5895-77ac-4012-a746-183e8a9c841d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance a3eb0aa7-8425-466e-b5e8-20186e80121e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9357621e-cd81-491a-87ac-803f576688c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Migration f92cff73-04ac-4f68-9ee5-9d18ef237e54 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:16:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:16:36 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:16:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:16:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:16:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:16:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:16:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'serial': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085'}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085', 'serial'} {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:42 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a19a1a9-07f6-4863-b270-3ce922d142c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:42 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d202bf1-40cc-467d-9e8a-578d42d4d616]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3] added
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa058941-b00b-4a15-be1e-bddb49ed6102]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f9865-a7a3-4e66-8576-9e1733c3ffac]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpOcAgvn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hpOcAgvn" returned: 0 in 0.066s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aec3c8-9809-419c-9d78-61ef676e87f0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hpOcAgvn'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0263b1cc-3e1b-4fee-845b-5b3d775c880e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bf41f6-efa1-4f9a-bfbc-bf42bf2b5055]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a2683e-2f94-4116-8e6c-014d1c1f0ef5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]
Nov 08 15:16:43 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffec3952-6d34-489e-aaba-ca83feab105b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47db00e-7f56-4338-9da2-b7829f6fd14d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:43 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72964c-5c06-45d6-8f6e-3c02139d932f]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:16:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Creating image(s)
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start _get_guest_xml network_info=[{"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8defda1b-5de4-4d07-8d5c-8fd1b26333b5', 'attached_at': '', 'detached_at': '', 'volume_id': '2b5251fd-3275-45d8-994c-180882761901', 'serial': '2b5251fd-3275-45d8-994c-180882761901'}, 'attachment_id': 'd9a63d55-23b4-4d7d-b922-c09c60905983', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:16:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 15:16:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:44 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23532313962353335', 'path': '/dev/sdf'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532313962353335', 'path': '/dev/sdf'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.306s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:44 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:44 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lazy-loading 'flavor' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf2317-198d-4455-803b-9257ca21d59c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:44 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff9964-e259-4b41-8716-17798f3d69bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901] added
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[05723ace-cd8c-4f6b-bbdb-1d7b5a20afce]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c00a1b-6fc3-4248-aa59-b1b558df5e95]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvKUlEFp {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvKUlEFp" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd75efe-e539-4ba0-b243-4d2f225acaa4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvKUlEFp'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[09062304-959c-4425-95ca-f1b908ddd36a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[353345fe-3cbc-4539-b482-c21e264bb13e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[026c6739-d0b9-4758-8cbf-a9df43eac02b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]
Nov 08 15:16:44 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e362de0-e269-457f-bd83-73557be3cfee]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70450d0-a963-4426-adcb-c7c4a5018857]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:44 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] HCTL ('41', '-', '-', 0) found on session 18 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc0b6b-2d27-4559-b4f8-7405539db485]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching for a device in session 18 and hctl ['41', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:16:44 user nova-compute[74788]: INFO nova.compute.claims [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Claim successful on node user
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Searching for a device in session 18 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== connect_volume: return (1711ms) {'type': 'block', 'scsi_wwn': '26333656438383939', 'path': '/dev/sdj'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333656438383939', 'path': '/dev/sdj'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431378698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:16:45 user nova-compute[74788]:   <uuid>8defda1b-5de4-4d07-8d5c-8fd1b26333b5</uuid>
Nov 08 15:16:45 user nova-compute[74788]:   <name>instance-00000008</name>
Nov 08 15:16:45 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:16:45 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:16:45 user nova-compute[74788]:   <metadata>
Nov 08 15:16:45 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:45 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:16:45 user nova-compute[74788]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1431378698</nova:name>
Nov 08 15:16:45 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:16:44</nova:creationTime>
Nov 08 15:16:45 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:16:45 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:45 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:16:45 user nova-compute[74788]:       <nova:owner>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:user uuid="fc01abecef094ba7a60598071aef302d">tempest-ServerActionsV293TestJSON-1497590387-project-member</nova:user>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:project uuid="dbd9e29971b9494cae915e79db86fa47">tempest-ServerActionsV293TestJSON-1497590387</nova:project>
Nov 08 15:16:45 user nova-compute[74788]:       </nova:owner>
Nov 08 15:16:45 user nova-compute[74788]:       <nova:ports>
Nov 08 15:16:45 user nova-compute[74788]:         <nova:port uuid="aba69107-b8dd-4250-b080-574b0a47c91f">
Nov 08 15:16:45 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:16:45 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:45 user nova-compute[74788]:       </nova:ports>
Nov 08 15:16:45 user nova-compute[74788]:     </nova:instance>
Nov 08 15:16:45 user nova-compute[74788]:   </metadata>
Nov 08 15:16:45 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:16:45 user nova-compute[74788]:     <system>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="serial">8defda1b-5de4-4d07-8d5c-8fd1b26333b5</entry>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="uuid">8defda1b-5de4-4d07-8d5c-8fd1b26333b5</entry>
Nov 08 15:16:45 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:16:45 user nova-compute[74788]:     </system>
Nov 08 15:16:45 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:45 user nova-compute[74788]:   <os>
Nov 08 15:16:45 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:16:45 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:16:45 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:16:45 user nova-compute[74788]:   </os>
Nov 08 15:16:45 user nova-compute[74788]:   <features>
Nov 08 15:16:45 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:45 user nova-compute[74788]:     <apic/>
Nov 08 15:16:45 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:16:45 user nova-compute[74788]:   </features>
Nov 08 15:16:45 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:16:45 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:16:45 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:16:45 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:16:45 user nova-compute[74788]:   </clock>
Nov 08 15:16:45 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:16:45 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:16:45 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:16:45 user nova-compute[74788]:   </cpu>
Nov 08 15:16:45 user nova-compute[74788]:   <devices>
Nov 08 15:16:45 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:45 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:45 user nova-compute[74788]:       <source dev="/dev/sdj"/>
Nov 08 15:16:45 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:16:45 user nova-compute[74788]:       <serial>2b5251fd-3275-45d8-994c-180882761901</serial>
Nov 08 15:16:45 user nova-compute[74788]:     </disk>
Nov 08 15:16:45 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:45 user nova-compute[74788]:       <mac address="fa:16:3e:e4:13:36"/>
Nov 08 15:16:45 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:45 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:45 user nova-compute[74788]:       <target dev="tapaba69107-b8"/>
Nov 08 15:16:45 user nova-compute[74788]:     </interface>
Nov 08 15:16:45 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:16:45 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5/console.log" append="off"/>
Nov 08 15:16:45 user nova-compute[74788]:     </serial>
Nov 08 15:16:45 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:16:45 user nova-compute[74788]:     <video>
Nov 08 15:16:45 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:45 user nova-compute[74788]:     </video>
Nov 08 15:16:45 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:16:45 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:16:45 user nova-compute[74788]:     </rng>
Nov 08 15:16:45 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:16:45 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:16:45 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:16:45 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:45 user nova-compute[74788]:   </devices>
Nov 08 15:16:45 user nova-compute[74788]: </domain>
Nov 08 15:16:45 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431378698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG os_vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '471bcdbe-3515-55f3-835f-2fd19da4ce15', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.policy [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946d9aeee5664b8c8f2c2e09604df6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9989f0594d764f1b95aa6ee59d9b65ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 285212672 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaba69107-b8, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaba69107-b8, col_values=(('qos', UUID('a09ccba7-7b3d-4247-9d71-dc44060adf90')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaba69107-b8, col_values=(('external_ids', {'iface-id': 'aba69107-b8dd-4250-b080-574b0a47c91f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:13:36', 'vm-uuid': '8defda1b-5de4-4d07-8d5c-8fd1b26333b5'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:45 user nova-compute[74788]: INFO os_vif [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8')
Nov 08 15:16:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:16:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Creating image(s)
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "/opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "/opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] No VIF found with MAC fa:16:3e:e4:13:36, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.230s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 447741952 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.239s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk 1073741824" returned: 0 in 0.132s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.336s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Cannot resize image /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Ensure instance console log exists: /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Successfully created port: 5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 560988160 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Starting finish_migration {{(pid=74788) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:16:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Creating image(s)
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:48 user nova-compute[74788]: WARNING nova.compute.manager [req-cb3b8189-2e8c-48a0-910d-bdeed26dcbae req-08939419-ae4a-48c7-98fd-0bcbf9c2b0e2 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state active and task_state rebuild_spawning.
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.246s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk. size=21474836480 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk 21474836480 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk 21474836480" returned: 0 in 0.088s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Ensure instance console log exists: /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start _get_guest_xml network_info=[{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4d4cedbd-4e31-4aad-a580-da6aded0134f', 'attached_at': '2023-11-08T15:16:48.000000', 'detached_at': '', 'volume_id': 'edb139de-2a58-465f-8eb8-607ab11ae980', 'serial': 'edb139de-2a58-465f-8eb8-607ab11ae980'}, 'attachment_id': '2601ad26-b187-44a1-b217-0e4da2996361', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Successfully updated port: 5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:16:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquired lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-changed-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Refreshing instance network info cache due to event network-changed-5332d621-f5f3-4d74-b160-8c5d8df07812. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] Acquiring lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:16:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:49 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:49 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:49 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede1bea-19e6-43a8-9b6b-0ff4f32bd57e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:49 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3861abc-61a2-4f43-9b1c-d48c3ff41d51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3fc558-ccfc-4976-86b6-adc20af529d1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fef5693-bb51-4133-bad4-46d9cfc6c01a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 993001472 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3295315d-0266-4d04-a4b0-535f8ed22b17]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojykunta'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc64548-e7fd-422a-a2da-f8fd85c0b468]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9798ed6-8cd1-49f5-b435-8069d5ae4885]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0698365-039e-4310-9751-7ad99301fb0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:16:49 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b179d2-11b2-46a1-bce5-8147b28e870f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af8275-5341-4323-9fb3-08688fcee1cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:49 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.475s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] HCTL ('43', '-', '-', 0) found on session 19 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788417b-fcf1-4e48-9bf7-f8c274f1757c]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching for a device in session 19 and hctl ['43', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Updating instance_info_cache with network_info: [{"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Releasing lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Instance network_info: |[{"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] Acquired lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Refreshing network info cache for port 5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Start _get_guest_xml network_info=[{"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:16:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148287710',display_name='tempest-VolumesAdminNegativeTest-server-1148287710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148287710',id=12,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-63x4fgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:46Z,user_data=None,user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=a6743784-823a-4c49-adf0-6bdb4a30b476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'pci_devices' on Instance uuid a6743784-823a-4c49-adf0-6bdb4a30b476 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:16:49 user nova-compute[74788]:   <uuid>a6743784-823a-4c49-adf0-6bdb4a30b476</uuid>
Nov 08 15:16:49 user nova-compute[74788]:   <name>instance-0000000c</name>
Nov 08 15:16:49 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:16:49 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:16:49 user nova-compute[74788]:   <metadata>
Nov 08 15:16:49 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:49 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1148287710</nova:name>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:16:49</nova:creationTime>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:16:49 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:49 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:owner>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:user uuid="946d9aeee5664b8c8f2c2e09604df6da">tempest-VolumesAdminNegativeTest-571382466-project-member</nova:user>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:project uuid="9989f0594d764f1b95aa6ee59d9b65ea">tempest-VolumesAdminNegativeTest-571382466</nova:project>
Nov 08 15:16:49 user nova-compute[74788]:       </nova:owner>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:49 user nova-compute[74788]:       <nova:ports>
Nov 08 15:16:49 user nova-compute[74788]:         <nova:port uuid="5332d621-f5f3-4d74-b160-8c5d8df07812">
Nov 08 15:16:49 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:49 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:49 user nova-compute[74788]:       </nova:ports>
Nov 08 15:16:49 user nova-compute[74788]:     </nova:instance>
Nov 08 15:16:49 user nova-compute[74788]:   </metadata>
Nov 08 15:16:49 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:16:49 user nova-compute[74788]:     <system>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="serial">a6743784-823a-4c49-adf0-6bdb4a30b476</entry>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="uuid">a6743784-823a-4c49-adf0-6bdb4a30b476</entry>
Nov 08 15:16:49 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:16:49 user nova-compute[74788]:     </system>
Nov 08 15:16:49 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:49 user nova-compute[74788]:   <os>
Nov 08 15:16:49 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:16:49 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:16:49 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:16:49 user nova-compute[74788]:   </os>
Nov 08 15:16:49 user nova-compute[74788]:   <features>
Nov 08 15:16:49 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:49 user nova-compute[74788]:     <apic/>
Nov 08 15:16:49 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:16:49 user nova-compute[74788]:   </features>
Nov 08 15:16:49 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:16:49 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:16:49 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:16:49 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:16:49 user nova-compute[74788]:   </clock>
Nov 08 15:16:49 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:16:49 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:16:49 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:16:49 user nova-compute[74788]:   </cpu>
Nov 08 15:16:49 user nova-compute[74788]:   <devices>
Nov 08 15:16:49 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:16:49 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:16:49 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk"/>
Nov 08 15:16:49 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:16:49 user nova-compute[74788]:     </disk>
Nov 08 15:16:49 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:49 user nova-compute[74788]:       <mac address="fa:16:3e:44:f1:1e"/>
Nov 08 15:16:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:49 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:49 user nova-compute[74788]:       <target dev="tap5332d621-f5"/>
Nov 08 15:16:49 user nova-compute[74788]:     </interface>
Nov 08 15:16:49 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:16:49 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/console.log" append="off"/>
Nov 08 15:16:49 user nova-compute[74788]:     </serial>
Nov 08 15:16:49 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:16:49 user nova-compute[74788]:     <video>
Nov 08 15:16:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:49 user nova-compute[74788]:     </video>
Nov 08 15:16:49 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:16:49 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:16:49 user nova-compute[74788]:     </rng>
Nov 08 15:16:49 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:16:49 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:16:49 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:16:49 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:49 user nova-compute[74788]:   </devices>
Nov 08 15:16:49 user nova-compute[74788]: </domain>
Nov 08 15:16:49 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148287710',display_name='tempest-VolumesAdminNegativeTest-server-1148287710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148287710',id=12,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-63x4fgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:46Z,user_data=None,user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=a6743784-823a-4c49-adf0-6bdb4a30b476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_vif [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4944596d-a734-5719-a9d3-e13df9dc42ef', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5332d621-f5, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5332d621-f5, col_values=(('qos', UUID('7f41dc18-d3cf-4ced-b62d-0fe0baf02988')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5332d621-f5, col_values=(('external_ids', {'iface-id': '5332d621-f5f3-4d74-b160-8c5d8df07812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:f1:1e', 'vm-uuid': 'a6743784-823a-4c49-adf0-6bdb4a30b476'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLaQjIpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'c6eedca6-20a0-493c-894f-8376631a2085'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:49 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:49 user nova-compute[74788]: INFO os_vif [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5')
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] No VIF found with MAC fa:16:3e:44:f1:1e, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Updated VIF entry in instance network info cache for port 5332d621-f5f3-4d74-b160-8c5d8df07812. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Updating instance_info_cache with network_info: [{"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6f21fdd2-9add-4001-8157-65598cc7ad14 req-67dfaccc-80f0-484b-a6cd-6abf455b2647 service nova] Releasing lock "refresh_cache-a6743784-823a-4c49-adf0-6bdb4a30b476" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:50 user nova-compute[74788]: WARNING nova.compute.manager [req-aa06362b-a185-41fd-8f80-b023159ed07e req-1698ba0f-8652-4ed5-bb5d-4d56787008c9 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state active and task_state rebuild_spawning.
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching for a device in session 19 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdl'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdl'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.664s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc61aa-06fd-4af3-80ee-2d979742c684]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:16:50 user nova-compute[74788]: No targets found.
Nov 08 15:16:50 user nova-compute[74788]: iSNS:
Nov 08 15:16:50 user nova-compute[74788]: No targets found.
Nov 08 15:16:50 user nova-compute[74788]: STATIC:
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:16:50 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:50 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:50 user nova-compute[74788]: FIRMWARE:
Nov 08 15:16:50 user nova-compute[74788]: No targets found.
Nov 08 15:16:50 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:16:50 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:16:50 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:16:50 user nova-compute[74788]:   <uuid>4d4cedbd-4e31-4aad-a580-da6aded0134f</uuid>
Nov 08 15:16:50 user nova-compute[74788]:   <name>instance-00000001</name>
Nov 08 15:16:50 user nova-compute[74788]:   <memory>2097152</memory>
Nov 08 15:16:50 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:16:50 user nova-compute[74788]:   <metadata>
Nov 08 15:16:50 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:50 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherB-server-1076661114</nova:name>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:16:48</nova:creationTime>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:flavor name="m1.small">
Nov 08 15:16:50 user nova-compute[74788]:         <nova:memory>2048</nova:memory>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:disk>20</nova:disk>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:50 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:owner>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:user uuid="c4cd49810cc347279c7f97ab21bc9e36">tempest-ServerActionsTestOtherB-108483217-project-member</nova:user>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:project uuid="4931b5b5c3724596ae964178f6683416">tempest-ServerActionsTestOtherB-108483217</nova:project>
Nov 08 15:16:50 user nova-compute[74788]:       </nova:owner>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:50 user nova-compute[74788]:       <nova:ports>
Nov 08 15:16:50 user nova-compute[74788]:         <nova:port uuid="210c398c-b530-47f9-9e1b-e8d1b41f6389">
Nov 08 15:16:50 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:16:50 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:50 user nova-compute[74788]:       </nova:ports>
Nov 08 15:16:50 user nova-compute[74788]:     </nova:instance>
Nov 08 15:16:50 user nova-compute[74788]:   </metadata>
Nov 08 15:16:50 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:16:50 user nova-compute[74788]:     <system>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="serial">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="uuid">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:16:50 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:16:50 user nova-compute[74788]:     </system>
Nov 08 15:16:50 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:50 user nova-compute[74788]:   <os>
Nov 08 15:16:50 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:16:50 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:16:50 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:16:50 user nova-compute[74788]:   </os>
Nov 08 15:16:50 user nova-compute[74788]:   <features>
Nov 08 15:16:50 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:50 user nova-compute[74788]:     <apic/>
Nov 08 15:16:50 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:16:50 user nova-compute[74788]:   </features>
Nov 08 15:16:50 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:16:50 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:16:50 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:16:50 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:16:50 user nova-compute[74788]:   </clock>
Nov 08 15:16:50 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:16:50 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:16:50 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:16:50 user nova-compute[74788]:   </cpu>
Nov 08 15:16:50 user nova-compute[74788]:   <devices>
Nov 08 15:16:50 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:16:50 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:16:50 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk"/>
Nov 08 15:16:50 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:16:50 user nova-compute[74788]:     </disk>
Nov 08 15:16:50 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:50 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:50 user nova-compute[74788]:       <source dev="/dev/sdl"/>
Nov 08 15:16:50 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:16:50 user nova-compute[74788]:       <serial>edb139de-2a58-465f-8eb8-607ab11ae980</serial>
Nov 08 15:16:50 user nova-compute[74788]:     </disk>
Nov 08 15:16:50 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:50 user nova-compute[74788]:       <mac address="fa:16:3e:31:6b:13"/>
Nov 08 15:16:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:50 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:50 user nova-compute[74788]:       <target dev="tap210c398c-b5"/>
Nov 08 15:16:50 user nova-compute[74788]:     </interface>
Nov 08 15:16:50 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:16:50 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/console.log" append="off"/>
Nov 08 15:16:50 user nova-compute[74788]:     </serial>
Nov 08 15:16:50 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:16:50 user nova-compute[74788]:     <video>
Nov 08 15:16:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:50 user nova-compute[74788]:     </video>
Nov 08 15:16:50 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:16:50 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:16:50 user nova-compute[74788]:     </rng>
Nov 08 15:16:50 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:16:50 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:16:50 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:16:50 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:50 user nova-compute[74788]:   </devices>
Nov 08 15:16:50 user nova-compute[74788]: </domain>
Nov 08 15:16:50 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1443805586-network", "vif_mac": "fa:16:3e:31:6b:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc4a5a5-ebd3-55c5-9d8c-9f1b6117bd78', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[105b6608-ee71-4235-aa5c-fd23b05f6461]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap210c398c-b5, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap210c398c-b5, col_values=(('qos', UUID('1163817a-0aba-4540-a176-eb030430a6b5')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap210c398c-b5, col_values=(('external_ids', {'iface-id': '210c398c-b530-47f9-9e1b-e8d1b41f6389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:6b:13', 'vm-uuid': '4d4cedbd-4e31-4aad-a580-da6aded0134f'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415a280-3e9a-41c4-a5c7-7497e8b608ee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:50 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:50 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c3c2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:50 user nova-compute[74788]: INFO os_vif [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2b45c-5714-45a9-bf1e-4d78246dfc49]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a930042-56a6-487e-a91f-adddc3ac021c]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] No VIF found with MAC fa:16:3e:31:6b:13, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[268abf00-b59f-416a-ab05-d05e27edebb0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:16:50 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance spawned successfully.
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071bc79-55d4-44b1-bb0c-f7e1cc4ef09b]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c140a945-ec59-470a-a3f4-c7ca8cd7de9c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93480932-7290-4711-b237-74db1d45f3c4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260]
Nov 08 15:16:50 user nova-compute[74788]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:50 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.objects.instance [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74788) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eedca6-20a0-493c-894f-8376631a2085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46274d5-ac56-4f8c-9d8d-02fa8b11f1eb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] <== disconnect_volume: return (1100ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48b07831-e290-40ac-9363-fbd606706f0a tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3e877b14-1461-4307-8bc9-363e1efaaa94', 'attached_at': '', 'detached_at': '', 'volume_id': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'serial'} {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: removing Cinder connection for volume c6eedca6-20a0-493c-894f-8376631a2085 {{(pid=74788) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:52 user nova-compute[74788]: WARNING nova.compute.manager [req-6672fc5b-a554-43c7-9466-ec368df0398e req-7f0920b3-c8b3-4c8d-b309-b2ac2fb1bce3 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state building and task_state spawning.
Nov 08 15:16:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] swap_volume: Updating volume c6eedca6-20a0-493c-894f-8376631a2085 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "hpOcAgvn", "auth_password": "ncrxm3UwEYWQgX", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "e75ebf1b-dff4-4520-83b3-0316ba582fa3"}, "status": "reserved", "instance": "3e877b14-1461-4307-8bc9-363e1efaaa94", "attached_at": "", "detached_at": "", "volume_id": "e75ebf1b-dff4-4520-83b3-0316ba582fa3", "serial": "e75ebf1b-dff4-4520-83b3-0316ba582fa3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'no_device': None, 'attachment_id': 'b028195e-09df-4291-84af-fb26bbc55df9'} {{(pid=74788) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6cb7487b-a3c1-4d2c-9f37-03bde1c048b3 tempest-TestVolumeSwap-1876563620 tempest-TestVolumeSwap-1876563620-project-admin] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 37.460s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:53 user nova-compute[74788]: WARNING nova.compute.manager [req-35c4f437-f233-47c7-a4cc-7d91d968e5fe req-ab2aa74b-2621-4da6-b0f4-4a505da7f908 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state resize_finish.
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:53 user nova-compute[74788]: INFO nova.compute.manager [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Detaching volume e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:16:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:53 user nova-compute[74788]: INFO nova.virt.block_device [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Attempting to driver detach volume e75ebf1b-dff4-4520-83b3-0316ba582fa3 from mountpoint /dev/vdb
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Attempting to detach device vdb from instance 3e877b14-1461-4307-8bc9-363e1efaaa94 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:16:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:53 user nova-compute[74788]:   <source dev="/dev/sdf"/>
Nov 08 15:16:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:16:53 user nova-compute[74788]:   <serial>e75ebf1b-dff4-4520-83b3-0316ba582fa3</serial>
Nov 08 15:16:53 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:16:53 user nova-compute[74788]: </disk>
Nov 08 15:16:53 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:16:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Successfully detached device vdb from instance 3e877b14-1461-4307-8bc9-363e1efaaa94 from the persistent domain config.
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e877b14-1461-4307-8bc9-363e1efaaa94 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:16:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:16:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:53 user nova-compute[74788]:   <source dev="/dev/sdf"/>
Nov 08 15:16:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:16:53 user nova-compute[74788]:   <serial>e75ebf1b-dff4-4520-83b3-0316ba582fa3</serial>
Nov 08 15:16:53 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:16:53 user nova-compute[74788]: </disk>
Nov 08 15:16:53 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:54 user nova-compute[74788]: WARNING nova.compute.manager [req-6b78e8a0-4e93-47dc-922b-a8bd108991b0 req-6fa1301b-7140-4e6d-b578-106809166412 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state building and task_state spawning.
Nov 08 15:16:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:16:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'info_cache' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:55 user nova-compute[74788]: WARNING nova.compute.manager [req-cb669557-05da-4eb9-a5ab-d67c9160cce7 req-ecdf43b2-e722-43c1-a028-cf92ca38c747 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state resize_finish.
Nov 08 15:16:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:16:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Instance spawned successfully.
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:16:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:16:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance running successfully.
Nov 08 15:16:56 user nova-compute[74788]: INFO nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Took 9.95 seconds to spawn the instance on the hypervisor.
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Failed to set time: agent not configured {{(pid=74788) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0c31b859-45f7-438b-82e3-ef6cf989b014 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] finish_migration finished successfully. {{(pid=74788) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:16:56 user nova-compute[74788]: INFO nova.compute.manager [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Took 11.19 seconds to build instance.
Nov 08 15:16:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance destroyed successfully.
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'resources' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f5b33356-43f6-4ec2-bd14-a577740e0f00 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.339s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64118033-36, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84e843a1-b43b-495a-a62f-c0e7c5d0ae4a) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: INFO os_vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:56 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351bbf2-4e59-47b3-a90d-714e11e654e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:16:56 user nova-compute[74788]: No targets found.
Nov 08 15:16:56 user nova-compute[74788]: iSNS:
Nov 08 15:16:56 user nova-compute[74788]: No targets found.
Nov 08 15:16:56 user nova-compute[74788]: STATIC:
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:16:56 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:16:56 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:16:56 user nova-compute[74788]: FIRMWARE:
Nov 08 15:16:56 user nova-compute[74788]: No targets found.
Nov 08 15:16:56 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:16:56 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:16:56 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4a274-45b9-4570-98c7-8a39bfb3820a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fea8ce-c95a-40e0-a35b-6cae7f65cc2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:56 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:56 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585afbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[692bea18-53a9-4ca0-8d73-86608574e3d8]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd35d44-0533-4d8a-a3f1-bc08c317505d]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1016cd6f-f0b8-46f5-bfa8-2a80d9d69b1d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0021e24-f5dc-4af0-9ccf-c2ac8ca625a1]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[83383677-330f-4278-ac10-914334fa429d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dce153-19fd-410d-a66d-cfeed6da6f76]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]
Nov 08 15:16:56 user nova-compute[74788]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:56 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: INFO nova.compute.manager [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Terminating instance
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[789603f0-78b3-41e0-a8d4-d3ab8253e71c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== disconnect_volume: return (441ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start _get_guest_xml network_info=[{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '16d4b216-2642-4df7-b0dd-a8b7da36b88e', 'attached_at': '', 'detached_at': '', 'volume_id': '2d247311-d76c-4f7f-8cfe-858866681f85', 'serial': '2d247311-d76c-4f7f-8cfe-858866681f85'}, 'attachment_id': 'c4e6c571-9ed3-4de6-8de2-2768f62a4a15', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'numa_topology' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:16:56 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:56 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:16:56 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ae58aa-e250-4e1b-9063-5231e6349421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:16:56 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[09791957-e22a-41d6-92c6-d8952653a549]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85] added
Nov 08 15:16:56 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6a9fc8-5cf5-487a-a24c-8c53bb5437ab]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a71f5f-a2ce-4545-99b6-eb67be6c8d0f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HplrVbMq {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HplrVbMq" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d38c8-923a-49e4-9dbd-248bfdf3b16f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HplrVbMq'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f50b2f-4232-4016-8517-0b4bc40dbeaa]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770bc73-a7cd-4177-9efc-04ece9269b32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d077e848-21e3-4c56-86dd-0cf970e9bb5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]
Nov 08 15:16:57 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.
Nov 08 15:16:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b3f12-89c2-4342-ad9c-fd579dc2e79e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a641bee2-ddac-46fb-82e4-f8377e58e159]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:16:57 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:16:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e1c226-1347-431e-9bb2-febde8649842]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:16:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Instance destroyed successfully.
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.objects.instance [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lazy-loading 'resources' on Instance uuid 9b540dd4-ac0f-41a2-941a-a7dd519d2922 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140230710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140230710',id=5,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPdYN3nBF877ZkrVaBsLLgFdOhWwiTPzJousmKBDtF+5nzzEC6DEzLnwufkm9eCtpnTQcBN0uDLl5C6AhclNn0f+y+4e0Ua9q/DkB0uAMrrPIcIdu3+/TjMHbdhg1d7Hw==',key_name='tempest-keypair-1922037122',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad0a360ac3974426b6f6aea8e48dcfb9',ramdisk_id='',reservation_id='r-8xlahbfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1767194789',owner_user_name='tempest-TaggedAttachmentsTest-1767194789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649cb7a8623d4a70933af2e4742921ce',uuid=9b540dd4-ac0f-41a2-941a-a7dd519d2922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converting VIF {"id": "2d460349-ac8e-41df-a62f-9b36089aa51f", "address": "fa:16:3e:3e:9d:5a", "network": {"id": "7f67f161-6922-47fd-a238-143cd5f08756", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2081238910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad0a360ac3974426b6f6aea8e48dcfb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d460349-ac", "ovs_interfaceid": "2d460349-ac8e-41df-a62f-9b36089aa51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG os_vif [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d460349-ac, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=991d132d-b86f-492a-9b07-c0042f83eb3f) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:57 user nova-compute[74788]: INFO os_vif [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:9d:5a,bridge_name='br-int',has_traffic_filtering=True,id=2d460349-ac8e-41df-a62f-9b36089aa51f,network=Network(7f67f161-6922-47fd-a238-143cd5f08756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d460349-ac')
Nov 08 15:16:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Deleting instance files /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922_del
Nov 08 15:16:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Deletion of /opt/stack/data/nova/instances/9b540dd4-ac0f-41a2-941a-a7dd519d2922_del complete
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-unplugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-unplugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-unplugged-2d460349-ac8e-41df-a62f-9b36089aa51f for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Acquiring lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] No waiting events found dispatching network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:57 user nova-compute[74788]: WARNING nova.compute.manager [req-0ffc84d0-5ef5-46de-aa3d-e059a60b0225 req-189552c6-88d0-4549-aab5-b2603009f4d5 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received unexpected event network-vif-plugged-2d460349-ac8e-41df-a62f-9b36089aa51f for instance with vm_state active and task_state deleting.
Nov 08 15:16:57 user nova-compute[74788]: INFO nova.compute.manager [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:57 user nova-compute[74788]: INFO nova.compute.manager [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Terminating instance
Nov 08 15:16:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:16:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '26539356432393364', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539356432393364', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:16:58 user nova-compute[74788]:   <uuid>16d4b216-2642-4df7-b0dd-a8b7da36b88e</uuid>
Nov 08 15:16:58 user nova-compute[74788]:   <name>instance-00000002</name>
Nov 08 15:16:58 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:16:58 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:16:58 user nova-compute[74788]:   <metadata>
Nov 08 15:16:58 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:16:58 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeTestJSON-server-70773012</nova:name>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:16:56</nova:creationTime>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:16:58 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:16:58 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:owner>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:user uuid="649a41ab82754c269c03606c18428b86">tempest-AttachVolumeTestJSON-1302335670-project-member</nova:user>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:project uuid="7984a5e14b104fdbbe50c0171702b765">tempest-AttachVolumeTestJSON-1302335670</nova:project>
Nov 08 15:16:58 user nova-compute[74788]:       </nova:owner>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:16:58 user nova-compute[74788]:       <nova:ports>
Nov 08 15:16:58 user nova-compute[74788]:         <nova:port uuid="64118033-36fd-4778-a574-53d4a32ec9c1">
Nov 08 15:16:58 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:16:58 user nova-compute[74788]:         </nova:port>
Nov 08 15:16:58 user nova-compute[74788]:       </nova:ports>
Nov 08 15:16:58 user nova-compute[74788]:     </nova:instance>
Nov 08 15:16:58 user nova-compute[74788]:   </metadata>
Nov 08 15:16:58 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:16:58 user nova-compute[74788]:     <system>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="serial">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="uuid">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:16:58 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:16:58 user nova-compute[74788]:     </system>
Nov 08 15:16:58 user nova-compute[74788]:   </sysinfo>
Nov 08 15:16:58 user nova-compute[74788]:   <os>
Nov 08 15:16:58 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:16:58 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:16:58 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:16:58 user nova-compute[74788]:   </os>
Nov 08 15:16:58 user nova-compute[74788]:   <features>
Nov 08 15:16:58 user nova-compute[74788]:     <acpi/>
Nov 08 15:16:58 user nova-compute[74788]:     <apic/>
Nov 08 15:16:58 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:16:58 user nova-compute[74788]:   </features>
Nov 08 15:16:58 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:16:58 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:16:58 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:16:58 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:16:58 user nova-compute[74788]:   </clock>
Nov 08 15:16:58 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:16:58 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:16:58 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:16:58 user nova-compute[74788]:   </cpu>
Nov 08 15:16:58 user nova-compute[74788]:   <devices>
Nov 08 15:16:58 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:16:58 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:16:58 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk"/>
Nov 08 15:16:58 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:16:58 user nova-compute[74788]:     </disk>
Nov 08 15:16:58 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:16:58 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:16:58 user nova-compute[74788]:       <source dev="/dev/sdc"/>
Nov 08 15:16:58 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:16:58 user nova-compute[74788]:       <serial>2d247311-d76c-4f7f-8cfe-858866681f85</serial>
Nov 08 15:16:58 user nova-compute[74788]:     </disk>
Nov 08 15:16:58 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:16:58 user nova-compute[74788]:       <mac address="fa:16:3e:35:3e:45"/>
Nov 08 15:16:58 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:58 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:16:58 user nova-compute[74788]:       <target dev="tap64118033-36"/>
Nov 08 15:16:58 user nova-compute[74788]:     </interface>
Nov 08 15:16:58 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:16:58 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/console.log" append="off"/>
Nov 08 15:16:58 user nova-compute[74788]:     </serial>
Nov 08 15:16:58 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:16:58 user nova-compute[74788]:     <video>
Nov 08 15:16:58 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:16:58 user nova-compute[74788]:     </video>
Nov 08 15:16:58 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:16:58 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:16:58 user nova-compute[74788]:     </rng>
Nov 08 15:16:58 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:16:58 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:16:58 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:16:58 user nova-compute[74788]:     </memballoon>
Nov 08 15:16:58 user nova-compute[74788]:   </devices>
Nov 08 15:16:58 user nova-compute[74788]: </domain>
Nov 08 15:16:58 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Instance destroyed successfully.
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lazy-loading 'resources' on Instance uuid 5e2c5895-77ac-4012-a746-183e8a9c841d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-707679632',display_name='tempest-VolumesAssistedSnapshotsTest-server-707679632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-707679632',id=7,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZoZP5pEPETFrwHLJ2RKqNlGR+hAdJrc9mCY0p00StMxIP5yBPvLWLji9D1+k6rlLBap/Ypu8L8cOKvPvGwUHH9qKDFcqt4meUiUO1c84CAq9+Dq2FGp0EtMa7KJ3mDrA==',key_name='tempest-keypair-433980243',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac35e95502a46c698f5466e10607cb3',ramdisk_id='',reservation_id='r-wxmvfkq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-808077194',owner_user_name='tempest-VolumesAssistedSnapshotsTest-808077194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa0eb377065b49e195ffbb567e9f24d5',uuid=5e2c5895-77ac-4012-a746-183e8a9c841d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converting VIF {"id": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "address": "fa:16:3e:a9:71:76", "network": {"id": "ca4fbf17-e0ba-467f-8160-dbbd852d4271", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-259676156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac35e95502a46c698f5466e10607cb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7083d1ad-fe", "ovs_interfaceid": "7083d1ad-fe21-4bf4-9330-4c751f45ccc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG os_vif [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7083d1ad-fe, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0cc335f-d664-422d-97ed-71c1058a9a8d) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:58 user nova-compute[74788]: INFO os_vif [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:71:76,bridge_name='br-int',has_traffic_filtering=True,id=7083d1ad-fe21-4bf4-9330-4c751f45ccc0,network=Network(ca4fbf17-e0ba-467f-8160-dbbd852d4271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7083d1ad-fe')
Nov 08 15:16:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Deleting instance files /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d_del
Nov 08 15:16:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Deletion of /opt/stack/data/nova/instances/5e2c5895-77ac-4012-a746-183e8a9c841d_del complete
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-changed-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Refreshing instance network info cache due to event network-changed-dee41a64-a441-4641-9d43-8a1fb62ed5d0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] Acquiring lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] Acquired lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Refreshing network info cache for port dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.422s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:59 user nova-compute[74788]: INFO nova.compute.manager [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:16:59 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Took 1.69 seconds to deallocate network for instance.
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-987b2f3d-101c-413f-9be7-03293455ba45 req-eab4778b-92d0-46d0-a4b1-5d11971ad193 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Received event network-vif-deleted-2d460349-ac8e-41df-a62f-9b36089aa51f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:59 user nova-compute[74788]: INFO nova.compute.manager [req-987b2f3d-101c-413f-9be7-03293455ba45 req-eab4778b-92d0-46d0-a4b1-5d11971ad193 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Neutron deleted interface 2d460349-ac8e-41df-a62f-9b36089aa51f; detaching it from the instance and deleting it from the info cache
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-987b2f3d-101c-413f-9be7-03293455ba45 req-eab4778b-92d0-46d0-a4b1-5d11971ad193 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-987b2f3d-101c-413f-9be7-03293455ba45 req-eab4778b-92d0-46d0-a4b1-5d11971ad193 service nova] [instance: 9b540dd4-ac0f-41a2-941a-a7dd519d2922] Detach interface failed, port_id=2d460349-ac8e-41df-a62f-9b36089aa51f, reason: Instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.325s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Cannot resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'migration_context' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.objects.base [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG os_vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbcf4317-c202-50ae-8943-fd435724e94e', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:59 user nova-compute[74788]: WARNING nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state active and task_state deleting.
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:16:59 user nova-compute[74788]: WARNING nova.compute.manager [req-6279a064-00fd-4e2d-bf04-e0a5e16ab2a3 req-99878987-a09d-4eca-bfe8-d3cc4e3f2900 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state active and task_state deleting.
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64118033-36, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64118033-36, col_values=(('qos', UUID('751f793a-ab2e-4771-ad0a-8b5c7a778e42')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64118033-36, col_values=(('external_ids', {'iface-id': '64118033-36fd-4778-a574-53d4a32ec9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3e:45', 'vm-uuid': '16d4b216-2642-4df7-b0dd-a8b7da36b88e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:16:59 user nova-compute[74788]: INFO os_vif [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:16:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updated VIF entry in instance network info cache for port dee41a64-a441-4641-9d43-8a1fb62ed5d0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating instance_info_cache with network_info: [{"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7dbdf3e5-033c-4b51-92e4-83880643437b req-5bbc5f19-b10e-499d-a160-b939bee82bc6 service nova] Releasing lock "refresh_cache-9357621e-cd81-491a-87ac-803f576688c2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.171s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:00 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Deleted allocations for instance 9b540dd4-ac0f-41a2-941a-a7dd519d2922
Nov 08 15:17:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:00 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:01 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Took 1.68 seconds to deallocate network for instance.
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.177s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa707e81-c157-4779-9806-1b971a16885c tempest-TaggedAttachmentsTest-1767194789 tempest-TaggedAttachmentsTest-1767194789-project-member] Lock "9b540dd4-ac0f-41a2-941a-a7dd519d2922" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.461s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:01 user nova-compute[74788]: INFO nova.compute.manager [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attaching volume fc8d7ace-0c3b-447b-94dc-60cbcceceb92 to /dev/vdb
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.utils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db2bad-14ce-4db6-92e4-51c215e20efc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-ce6054ec-9a95-45a6-b4a9-f35c661f3b88 req-ea8f2dfb-e8a4-433b-ac16-8c667956386c service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-deleted-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b6ccb-1b68-4e71-93f5-6e740ae8cc55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00469a7-5941-4483-a7da-654ca14de2dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd977ff-d8ca-4f5a-b919-8bdb81bf4de2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:17:01 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b16aa-1bf4-4775-881c-2f0bcf98ad57]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG os_brick.utils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating existing volume attachment record: 150f03f9-e36c-4307-af1e-a24e6b711095 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.685s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:01 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Deleted allocations for instance 5e2c5895-77ac-4012-a746-183e8a9c841d
Nov 08 15:17:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:02 user nova-compute[74788]: WARNING nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state deleted and task_state None.
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:02 user nova-compute[74788]: WARNING nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-unplugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state deleted and task_state None.
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Acquiring lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] No waiting events found dispatching network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:02 user nova-compute[74788]: WARNING nova.compute.manager [req-f0798080-335a-47bf-9995-ea77c0a46897 req-234e41ec-74be-4907-b16e-b127b03be1d3 service nova] [instance: 5e2c5895-77ac-4012-a746-183e8a9c841d] Received unexpected event network-vif-plugged-7083d1ad-fe21-4bf4-9330-4c751f45ccc0 for instance with vm_state deleted and task_state None.
Nov 08 15:17:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9510cb41-a091-4a0f-9c6c-27f8f8225bd3 tempest-VolumesAssistedSnapshotsTest-808077194 tempest-VolumesAssistedSnapshotsTest-808077194-project-member] Lock "5e2c5895-77ac-4012-a746-183e8a9c841d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.210s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:03 user nova-compute[74788]: WARNING nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state powering-on.
Nov 08 15:17:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:03 user nova-compute[74788]: WARNING nova.compute.manager [req-8a463893-14cd-4feb-a0a2-f88a1c360771 req-53f82333-82cd-4075-bfff-f52c7a1acccd service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state powering-on.
Nov 08 15:17:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:17:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance rebooted successfully.
Nov 08 15:17:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c4309198-01c8-4004-8835-4988d4fa3480 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:17:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3e877b14-1461-4307-8bc9-363e1efaaa94 is timed out.
Nov 08 15:17:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Successfully detached device vdb from instance 3e877b14-1461-4307-8bc9-363e1efaaa94 from the live domain config.
Nov 08 15:17:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hpOcAgvn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'e75ebf1b-dff4-4520-83b3-0316ba582fa3'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6fa2c9-fe45-4b43-9448-faef7c73a8da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:14 user nova-compute[74788]: No targets found.
Nov 08 15:17:14 user nova-compute[74788]: iSNS:
Nov 08 15:17:14 user nova-compute[74788]: No targets found.
Nov 08 15:17:14 user nova-compute[74788]: STATIC:
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:14 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:14 user nova-compute[74788]: No targets found.
Nov 08 15:17:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:14 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:14 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bcd229-47b6-418d-a32e-54749f9e448b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8f1178-0bd0-4c59-9bd5-60486cb9ae76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:17:14 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758502200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3'): ({'sdf'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Removing single pathed devices sdf {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d3ff3-cfd3-4a45-9049-41cc52d3f017]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3102a3d-6696-4f8b-95c2-9aef541a1121]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Flushing IO for device /dev/sdf {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e6663-244e-4f0a-be96-be20bdaf4881]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f4705-9bad-4371-8b7d-a4a63a61c1bc]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] SCSI volumes sdf have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e3aa7-6738-49c8-adb8-cc31dfd714bb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de67d9-f0fa-4993-94f9-5a1b67553dcf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260]
Nov 08 15:17:14 user nova-compute[74788]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e75ebf1b-dff4-4520-83b3-0316ba582fa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c2c34-d7f8-45c8-84fd-97d967f2d5a2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] <== disconnect_volume: return (432ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lazy-loading 'flavor' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c362cc3-59a5-46a7-a1f1-24f06d5097df tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.217s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-changed-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing instance network info cache due to event network-changed-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] Acquiring lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] Acquired lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG nova.network.neutron [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Refreshing network info cache for port dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG nova.network.neutron [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updated VIF entry in instance network info cache for port dd776e2c-f6f1-48cd-8c52-ea24de7b90ee. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG nova.network.neutron [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a096381-f3d7-4dbf-bbcb-9f1243e142e8 req-65375151-78ee-44ad-916d-7282ad016342 service nova] Releasing lock "refresh_cache-a3eb0aa7-8425-466e-b5e8-20186e80121e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:19 user nova-compute[74788]: INFO nova.compute.manager [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Terminating instance
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-90580de0-7f26-4e6e-9681-5c3f69233398 req-4533aadf-3e1a-4aa6-bfc9-b4dc1435e38b service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-7be226a2-6f2d-46a4-af59-00013f41f96e req-efd89582-675f-4662-82cc-f3a27701b4dc service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-e10248a7-49b3-4391-93d0-9349b292c2b0 req-4c3f3f84-2445-4a83-813b-474446381ad5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-c2ebf52e-0769-424d-bd4f-721dda443697 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Instance destroyed successfully.
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lazy-loading 'resources' on Instance uuid a3eb0aa7-8425-466e-b5e8-20186e80121e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd776e2c-f6, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7da6c37-24fa-4dfb-91a3-8f54dca4091e) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:cb,bridge_name='br-int',has_traffic_filtering=True,id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee,network=Network(4362b91d-ef38-43e9-ba04-a7d95becd76b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd776e2c-f6')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf9a7b4d-f4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6f1b22d-d437-43b2-b6c6-4f2aae68c540) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=af9a7b4d-f41c-4210-a8fa-8b56a6abe02e,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf9a7b4d-f4')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcd5386a-a4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c355483-e532-4b84-a6cd-744e62564408) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:de:dc,bridge_name='br-int',has_traffic_filtering=True,id=fcd5386a-a476-4bb0-a6a3-f88c500b3b89,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfcd5386a-a4')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1807f7bc-d0, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2feab133-a119-4ceb-82b8-e6fa53261294) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:76:b7,bridge_name='br-int',has_traffic_filtering=True,id=1807f7bc-d09c-457b-9da0-eba51c82ae67,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1807f7bc-d0')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "c2ebf52e-0769-424d-bd4f-721dda443697", "address": "fa:16:3e:f5:a7:fa", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ebf52e-07", "ovs_interfaceid": "c2ebf52e-0769-424d-bd4f-721dda443697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ebf52e-07, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ea6e0ee-5ba1-4fe9-9b90-a868d13c9ecc) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a7:fa,bridge_name='br-int',has_traffic_filtering=True,id=c2ebf52e-0769-424d-bd4f-721dda443697,network=Network(e5bda65f-2a13-4724-8b81-82fea1669f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ebf52e-07')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f03eb0d-2b, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32c397da-4cd4-49e2-b93c-4814450f767d) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:21 user nova-compute[74788]: WARNING nova.compute.manager [req-21dc4588-0346-46ca-9190-aedc9eb7536a req-a43e2b27-eb10-4ec8-88ea-b67e8d7b49a3 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-fcd5386a-a476-4bb0-a6a3-f88c500b3b89 for instance with vm_state active and task_state deleting.
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=7f03eb0d-2b92-418a-9630-5c836354c0fe,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f03eb0d-2b')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1796737526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1796737526',id=10,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV9ACgIqgXCC7kFdk+9WaXt7LG/KSrWLUtFgsa+3Mq0nyAh4npBw0Pc8KtihCIYGthnGFgQWftM9DBQ1jzwR8ezxT+SiWecAlv4JP7joi4+bt/7YsI7kmaFwZYrr8a/nA==',key_name='tempest-keypair-296427449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='267e279227b64367abe0b6f3d039de11',ramdisk_id='',reservation_id='r-uqdzmjyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-76015565',owner_user_name='tempest-TaggedBootDevicesTest_v242-76015565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d79cdc433984f32b193b6334732d5f3',uuid=a3eb0aa7-8425-466e-b5e8-20186e80121e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converting VIF {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2e7e46b-b0, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78fb2e1a-769d-48b3-bfd4-e8123d963223) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:21 user nova-compute[74788]: INFO os_vif [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=d2e7e46b-b063-4391-88f0-cb90487c6f92,network=Network(fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e7e46b-b0')
Nov 08 15:17:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJOFXkRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:21 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32f5aa-3444-473b-948e-ce033d6cddd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:21 user nova-compute[74788]: No targets found.
Nov 08 15:17:21 user nova-compute[74788]: iSNS:
Nov 08 15:17:21 user nova-compute[74788]: No targets found.
Nov 08 15:17:21 user nova-compute[74788]: STATIC:
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:21 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:21 user nova-compute[74788]: No targets found.
Nov 08 15:17:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:21 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:21 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b52ee-6f1c-486a-a93f-7393670bd43a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ad0f6-d3d3-4159-be4e-6f5ebccd4289]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc (non-flash)
Nov 08 15:17:21 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758576320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b333eb8c-b1df-4be5-9619-eea2081714cf]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-af9a7b4d-f41c-4210-a8fa-8b56a6abe02e for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-6e025037-5c99-4caa-b2ca-9b7887126eef req-1bd731c8-bb80-4372-ab10-21dba05946d8 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-1807f7bc-d09c-457b-9da0-eba51c82ae67 for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeafd2a-1350-404a-a685-337398e329f6]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99727b5-497a-4135-b623-7c8f61df902f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c8acf-cc89-4753-bce1-647fedefd417]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f3af9-cfa8-496b-80d6-c1d24ce037cf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[607dbf89-f950-4b6c-b4ac-e1dc40000107]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260]
Nov 08 15:17:22 user nova-compute[74788]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb450b81-c61c-4b4f-be45-59cbfd0760cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ba2bb-559d-459e-a360-085aecadb4ee]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== disconnect_volume: return (426ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpjUkdlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3d28c-7a32-4dbd-9fd4-62249bc8bef7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]: iSNS:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]: STATIC:
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:22 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:22 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea01c1-3185-4655-ad2a-f68d46da37ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe93b4-8209-4f3a-9b75-5a478fa0ce6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c65df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788'): ({'sdh'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Removing single pathed devices sdh {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c9e41-c3be-4757-b563-65fe5d7cfcab]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f93b87-9617-4eef-ad17-d56990b334d8]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Flushing IO for device /dev/sdh {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[055746af-9bce-4ab0-bd9a-8c6e353cb5ad]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-c2ebf52e-0769-424d-bd4f-721dda443697 for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-7f03eb0d-2b92-418a-9630-5c836354c0fe for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-7f03eb0d-2b92-418a-9630-5c836354c0fe for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-unplugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-unplugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Acquiring lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] No waiting events found dispatching network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING nova.compute.manager [req-210fb69f-ff88-46d6-b8c9-1323e7525ff3 req-9b2ffb30-b21c-4840-9184-9ec2eb53a7a5 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received unexpected event network-vif-plugged-d2e7e46b-b063-4391-88f0-cb90487c6f92 for instance with vm_state active and task_state deleting.
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c958f84-7c40-4221-8ede-356ef4da8b44]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] SCSI volumes sdh have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d3f0b9-f8e0-4eaa-96c4-4c83f07ec3a1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68c84a2-5167-419b-8951-678207a199c8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260]
Nov 08 15:17:22 user nova-compute[74788]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589db95a-8e57-45ef-9d18-91ea223c4788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a336047-89dc-49de-9f79-c48ee36b22c9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== disconnect_volume: return (364ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVbjiZhe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:22 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22338e-f6cf-4175-afbc-9f7d23d417f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]: iSNS:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]: STATIC:
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:22 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:22 user nova-compute[74788]: No targets found.
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:22 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:22 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[81477015-b35a-4003-9b87-5782c2fe548b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b43e167-7c9c-4fe4-9d88-83d0499bb2cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c65df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181'): ({'sdi'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Removing single pathed devices sdi {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08f2e4-5931-4975-93de-b6a302239416]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c71bfe-6731-4543-8397-8c5b80a555c0]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Flushing IO for device /dev/sdi {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a464a7-dbed-4eda-a325-35add74f5152]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c51a66-c30d-49a8-8c25-4ee340248667]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] SCSI volumes sdi have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1777607e-9c6e-40e2-806b-eddf3bbc9fe3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b113c4-bff3-49bf-afec-111a3246047f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260]
Nov 08 15:17:22 user nova-compute[74788]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d672ae-d8b1-4e47-af05-b239aa6dd181 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b1cdd-0f6b-40c5-81d5-d0cb71ee618e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] <== disconnect_volume: return (360ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Deleting instance files /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e_del
Nov 08 15:17:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Deletion of /opt/stack/data/nova/instances/a3eb0aa7-8425-466e-b5e8-20186e80121e_del complete
Nov 08 15:17:23 user nova-compute[74788]: INFO nova.compute.manager [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Took 4.02 seconds to destroy the instance on the hypervisor.
Nov 08 15:17:23 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:17:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:17:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-95356eb2-3271-442b-b72a-b28ef0353aeb req-c26a3e29-6f14-4ea3-a244-d0fda6918b7a service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-deleted-c2ebf52e-0769-424d-bd4f-721dda443697 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:26 user nova-compute[74788]: INFO nova.compute.manager [req-95356eb2-3271-442b-b72a-b28ef0353aeb req-c26a3e29-6f14-4ea3-a244-d0fda6918b7a service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Neutron deleted interface c2ebf52e-0769-424d-bd4f-721dda443697; detaching it from the instance and deleting it from the info cache
Nov 08 15:17:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-95356eb2-3271-442b-b72a-b28ef0353aeb req-c26a3e29-6f14-4ea3-a244-d0fda6918b7a service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "address": "fa:16:3e:bb:76:b7", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1807f7bc-d0", "ovs_interfaceid": "1807f7bc-d09c-457b-9da0-eba51c82ae67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-95356eb2-3271-442b-b72a-b28ef0353aeb req-c26a3e29-6f14-4ea3-a244-d0fda6918b7a service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Detach interface failed, port_id=c2ebf52e-0769-424d-bd4f-721dda443697, reason: Instance a3eb0aa7-8425-466e-b5e8-20186e80121e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:17:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-deleted-1807f7bc-d09c-457b-9da0-eba51c82ae67 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:28 user nova-compute[74788]: INFO nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Neutron deleted interface 1807f7bc-d09c-457b-9da0-eba51c82ae67; detaching it from the instance and deleting it from the info cache
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.network.neutron [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "address": "fa:16:3e:a7:cd:cb", "network": {"id": "4362b91d-ef38-43e9-ba04-a7d95becd76b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-810468301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd776e2c-f6", "ovs_interfaceid": "dd776e2c-f6f1-48cd-8c52-ea24de7b90ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Detach interface failed, port_id=1807f7bc-d09c-457b-9da0-eba51c82ae67, reason: Instance a3eb0aa7-8425-466e-b5e8-20186e80121e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-deleted-dd776e2c-f6f1-48cd-8c52-ea24de7b90ee {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:28 user nova-compute[74788]: INFO nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Neutron deleted interface dd776e2c-f6f1-48cd-8c52-ea24de7b90ee; detaching it from the instance and deleting it from the info cache
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.network.neutron [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "address": "fa:16:3e:57:fc:73", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f03eb0d-2b", "ovs_interfaceid": "7f03eb0d-2b92-418a-9630-5c836354c0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Detach interface failed, port_id=dd776e2c-f6f1-48cd-8c52-ea24de7b90ee, reason: Instance a3eb0aa7-8425-466e-b5e8-20186e80121e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-deleted-7f03eb0d-2b92-418a-9630-5c836354c0fe {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:28 user nova-compute[74788]: INFO nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Neutron deleted interface 7f03eb0d-2b92-418a-9630-5c836354c0fe; detaching it from the instance and deleting it from the info cache
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.network.neutron [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [{"id": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "address": "fa:16:3e:0b:b8:4d", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf9a7b4d-f4", "ovs_interfaceid": "af9a7b4d-f41c-4210-a8fa-8b56a6abe02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "address": "fa:16:3e:71:de:dc", "network": {"id": "e5bda65f-2a13-4724-8b81-82fea1669f4c", "bridge": "br-int", "label": "tempest-device-tagging-net1-2081893903", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcd5386a-a4", "ovs_interfaceid": "fcd5386a-a476-4bb0-a6a3-f88c500b3b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "address": "fa:16:3e:30:03:4e", "network": {"id": "fc2b4c44-ac7d-4af8-9ff7-d77a3d716a15", "bridge": "br-int", "label": "tempest-device-tagging-net2-1526956110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "267e279227b64367abe0b6f3d039de11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e7e46b-b0", "ovs_interfaceid": "d2e7e46b-b063-4391-88f0-cb90487c6f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-0d4af22c-f2de-4aa4-ba37-2167be0cdb79 req-6dc7a112-b79f-4964-a804-c464592f5c43 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Detach interface failed, port_id=7f03eb0d-2b92-418a-9630-5c836354c0fe, reason: Instance a3eb0aa7-8425-466e-b5e8-20186e80121e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:17:28 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Took 5.81 seconds to deallocate network for instance.
Nov 08 15:17:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-5cbb2388-6ed5-4963-8390-bb85b6976e62 req-2249ac9f-1443-4127-b164-626a6f947394 service nova] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Received event network-vif-deleted-d2e7e46b-b063-4391-88f0-cb90487c6f92 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItapTxEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:30 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:30 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:30 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf02a43-02f6-45fe-8389-2debef60df4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:17:30 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b0298-1259-4f8b-93f2-ad35f4e0a426]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92] added
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3415fb-4c45-4832-b4ab-4b5e56c50fea]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95e7c31-77b0-4a8d-a6c4-89a3d30bff11]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItapTxEK {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItapTxEK" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a04b39-29bd-4196-8060-e2bf17dfe94a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItapTxEK'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f34846-6b2e-4c79-866c-704af2908a1b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9fdb3-a89e-46d2-870b-21b56a95dc07]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3b720-937b-423a-9fe3-75e692599e76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260]
Nov 08 15:17:30 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10167635-3605-4ab2-b14f-3dc5b43cd345]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efeffec-01e1-4b16-86ba-2b5740473f57]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd46f00-3650-4654-8bf3-c51164b5f77c]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:17:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItapTxEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26633633461616537', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633633461616537', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:17:31 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:17:31 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:17:31 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:17:31 user nova-compute[74788]:   <serial>fc8d7ace-0c3b-447b-94dc-60cbcceceb92</serial>
Nov 08 15:17:31 user nova-compute[74788]: </disk>
Nov 08 15:17:31 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:17:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:32 user nova-compute[74788]: INFO nova.compute.manager [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] [instance: a3eb0aa7-8425-466e-b5e8-20186e80121e] Took 3.07 seconds to detach 3 volumes for instance.
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating instance_info_cache with network_info: [{"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-3e877b14-1461-4307-8bc9-363e1efaaa94" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No VIF found with MAC fa:16:3e:02:b2:66, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b660ab0c-428c-47b7-8bc0-fcf6ee8f8813 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.116s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:32 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Deleted allocations for instance a3eb0aa7-8425-466e-b5e8-20186e80121e
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0c205416-a818-4f47-8dc2-639f8deed2b0 tempest-TaggedBootDevicesTest_v242-76015565 tempest-TaggedBootDevicesTest_v242-76015565-project-member] Lock "a3eb0aa7-8425-466e-b5e8-20186e80121e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.514s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:32 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:36 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:17:36 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.60321807861328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Applying migration context for instance 4d4cedbd-4e31-4aad-a580-da6aded0134f as it has an incoming, in-progress migration f92cff73-04ac-4f68-9ee5-9d18ef237e54. Migration status is finished {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 15:17:36 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating resource usage from migration f92cff73-04ac-4f68-9ee5-9d18ef237e54
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:36 user nova-compute[74788]: INFO nova.compute.manager [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attaching volume 894f5da8-2694-4d9e-b79c-f9a9a9b996e9 to /dev/vdc
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.utils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e877b14-1461-4307-8bc9-363e1efaaa94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9357621e-cd81-491a-87ac-803f576688c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Migration f92cff73-04ac-4f68-9ee5-9d18ef237e54 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance a6743784-823a-4c49-adf0-6bdb4a30b476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbf963-7307-48ae-a8d8-44210a361671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e818c-3446-4a2c-857a-b8733f624288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3ed1a-1517-465d-a4fd-cfd4117d018b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f3ebb-bacb-4034-9ba1-aa0327da9729]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:17:36 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:17:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c233108-e998-409d-a482-e31d1b5be1e8]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG os_brick.utils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating existing volume attachment record: d89aa804-b2db-4083-9aa2-7927fe045421 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:17:37 user nova-compute[74788]: INFO nova.compute.claims [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Claim successful on node user
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:38 user nova-compute[74788]: WARNING nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid b89bfc12-601f-4fde-9d1f-3cc99469e9b8 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid a6743784-823a-4c49-adf0-6bdb4a30b476 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:17:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.policy [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c06d28d62994d15b3a91c5d210eea4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f737b11a8d4a88b798295956c0c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:17:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Creating image(s)
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG nova.virt.images [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] 01e1bbd8-d575-4619-9315-afa82edb0308 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.part /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Successfully created port: dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.part /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.converted" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.055s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462,backing_fmt=raw /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462,backing_fmt=raw /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk 1073741824" returned: 0 in 0.055s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "cd1a38bf77e805779ae6e37b46e18d8cede49462" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Successfully updated port: dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing instance network info cache due to event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Cannot resize image /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Ensure instance console log exists: /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance network_info: |[{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start _get_guest_xml network_info=[{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:17:35Z,direct_url=<?>,disk_format='qcow2',id=01e1bbd8-d575-4619-9315-afa82edb0308,min_disk=0,min_ram=0,name='tempest-scenario-img--1064876266',owner='a0f737b11a8d4a88b798295956c0c41f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:17:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '01e1bbd8-d575-4619-9315-afa82edb0308'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:17:40 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:17:40 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:17:35Z,direct_url=<?>,disk_format='qcow2',id=01e1bbd8-d575-4619-9315-afa82edb0308,min_disk=0,min_ram=0,name='tempest-scenario-img--1064876266',owner='a0f737b11a8d4a88b798295956c0c41f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:17:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:17:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'pci_devices' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:17:40 user nova-compute[74788]:   <uuid>bf5695e6-02aa-4093-a556-a62e367b5925</uuid>
Nov 08 15:17:40 user nova-compute[74788]:   <name>instance-0000000d</name>
Nov 08 15:17:40 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:17:40 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:17:40 user nova-compute[74788]:   <metadata>
Nov 08 15:17:40 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:17:40 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:name>tempest-TestMinimumBasicScenario-server-714106190</nova:name>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:17:40</nova:creationTime>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:17:40 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:17:40 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:owner>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:user uuid="4c06d28d62994d15b3a91c5d210eea4f">tempest-TestMinimumBasicScenario-181050692-project-member</nova:user>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:project uuid="a0f737b11a8d4a88b798295956c0c41f">tempest-TestMinimumBasicScenario-181050692</nova:project>
Nov 08 15:17:40 user nova-compute[74788]:       </nova:owner>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:root type="image" uuid="01e1bbd8-d575-4619-9315-afa82edb0308"/>
Nov 08 15:17:40 user nova-compute[74788]:       <nova:ports>
Nov 08 15:17:40 user nova-compute[74788]:         <nova:port uuid="dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d">
Nov 08 15:17:40 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:17:40 user nova-compute[74788]:         </nova:port>
Nov 08 15:17:40 user nova-compute[74788]:       </nova:ports>
Nov 08 15:17:40 user nova-compute[74788]:     </nova:instance>
Nov 08 15:17:40 user nova-compute[74788]:   </metadata>
Nov 08 15:17:40 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:17:40 user nova-compute[74788]:     <system>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="serial">bf5695e6-02aa-4093-a556-a62e367b5925</entry>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="uuid">bf5695e6-02aa-4093-a556-a62e367b5925</entry>
Nov 08 15:17:40 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:17:40 user nova-compute[74788]:     </system>
Nov 08 15:17:40 user nova-compute[74788]:   </sysinfo>
Nov 08 15:17:40 user nova-compute[74788]:   <os>
Nov 08 15:17:40 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:17:40 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:17:40 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:17:40 user nova-compute[74788]:   </os>
Nov 08 15:17:40 user nova-compute[74788]:   <features>
Nov 08 15:17:40 user nova-compute[74788]:     <acpi/>
Nov 08 15:17:40 user nova-compute[74788]:     <apic/>
Nov 08 15:17:40 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:17:40 user nova-compute[74788]:   </features>
Nov 08 15:17:40 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:17:40 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:17:40 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:17:40 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:17:40 user nova-compute[74788]:   </clock>
Nov 08 15:17:40 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:17:40 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:17:40 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:17:40 user nova-compute[74788]:   </cpu>
Nov 08 15:17:40 user nova-compute[74788]:   <devices>
Nov 08 15:17:40 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:17:40 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:17:40 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk"/>
Nov 08 15:17:40 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:17:40 user nova-compute[74788]:     </disk>
Nov 08 15:17:40 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:17:40 user nova-compute[74788]:       <mac address="fa:16:3e:17:6f:8c"/>
Nov 08 15:17:40 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:17:40 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:17:40 user nova-compute[74788]:       <target dev="tapdcf6e7bf-d4"/>
Nov 08 15:17:40 user nova-compute[74788]:     </interface>
Nov 08 15:17:40 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:17:40 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/console.log" append="off"/>
Nov 08 15:17:40 user nova-compute[74788]:     </serial>
Nov 08 15:17:40 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:17:40 user nova-compute[74788]:     <video>
Nov 08 15:17:40 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:17:40 user nova-compute[74788]:     </video>
Nov 08 15:17:40 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:17:40 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:17:40 user nova-compute[74788]:     </rng>
Nov 08 15:17:40 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:17:40 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:17:40 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:17:40 user nova-compute[74788]:     </memballoon>
Nov 08 15:17:40 user nova-compute[74788]:   </devices>
Nov 08 15:17:40 user nova-compute[74788]: </domain>
Nov 08 15:17:40 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:17:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG os_vif [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e90414cd-a3ee-5f94-834e-df11e7e0df04', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcf6e7bf-d4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcf6e7bf-d4, col_values=(('qos', UUID('e9564a28-0d43-4d4a-9dfc-7ec042477754')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcf6e7bf-d4, col_values=(('external_ids', {'iface-id': 'dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:6f:8c', 'vm-uuid': 'bf5695e6-02aa-4093-a556-a62e367b5925'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:40 user nova-compute[74788]: INFO os_vif [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4')
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No VIF found with MAC fa:16:3e:17:6f:8c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated VIF entry in instance network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1a081af5-1ff9-43e2-90fe-82f307c3babd req-6a403ae5-c052-4a97-b92a-b7c2568c37ce service nova] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:42 user nova-compute[74788]: WARNING nova.compute.manager [req-9469d05f-c19d-4cd9-8be1-bedf13406eff req-b069cc8e-3733-4508-af13-8a1e40cefbce service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state building and task_state spawning.
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:44 user nova-compute[74788]: INFO nova.compute.manager [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Terminating instance
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:17:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance spawned successfully.
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:44 user nova-compute[74788]: WARNING nova.compute.manager [req-b0fced1b-78df-4be0-af13-994b49a72e09 req-8e754b7d-030a-4317-95e0-bfeedd572d54 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state building and task_state spawning.
Nov 08 15:17:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:44 user nova-compute[74788]: INFO nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-unplugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] No waiting events found dispatching network-vif-unplugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-121d45d8-5e72-45e0-a66a-e56ec2907cb2 req-45ea5dd5-998e-4893-8f8f-cdba149a57ea service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-unplugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:44 user nova-compute[74788]: INFO nova.compute.manager [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Took 7.12 seconds to build instance.
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0cf3529d-621b-49b4-8b3a-67dbf0357ff1 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.250s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.747s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Instance destroyed successfully.
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lazy-loading 'resources' on Instance uuid 3e877b14-1461-4307-8bc9-363e1efaaa94 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1231602173',display_name='tempest-TestVolumeSwap-server-1231602173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1231602173',id=6,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIwVXgoQbJw262vxx7TsEs6jSpyTWuiVure+sLlWGskQ73Si2G5B55x2s06skPF8bKJkadWNc4nViDhg0qpt0+4X6RzHVuBEdAD1NPbivBvIy4SpfIL7tc8xv7CMOvb4Q==',key_name='tempest-keypair-1106911753',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1571ef1f543a4537a4d1c50d9aeaa5bc',ramdisk_id='',reservation_id='r-6x5lxhlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-878514580',owner_user_name='tempest-TestVolumeSwap-878514580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b172221dfe874ddc8635edb474d8c599',uuid=3e877b14-1461-4307-8bc9-363e1efaaa94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converting VIF {"id": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "address": "fa:16:3e:da:70:0f", "network": {"id": "7c987c75-44da-43be-9aa4-88847b44c19f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-470421261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1571ef1f543a4537a4d1c50d9aeaa5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap077f52bb-2f", "ovs_interfaceid": "077f52bb-2fa5-4f82-a470-9171cfe4ec62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG os_vif [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap077f52bb-2f, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7800e86-2d71-4003-865f-898f38219d28) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:45 user nova-compute[74788]: INFO os_vif [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=077f52bb-2fa5-4f82-a470-9171cfe4ec62,network=Network(7c987c75-44da-43be-9aa4-88847b44c19f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap077f52bb-2f')
Nov 08 15:17:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Deleting instance files /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94_del
Nov 08 15:17:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Deletion of /opt/stack/data/nova/instances/3e877b14-1461-4307-8bc9-363e1efaaa94_del complete
Nov 08 15:17:45 user nova-compute[74788]: INFO nova.compute.manager [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 15:17:45 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:17:45 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:46 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Took 0.95 seconds to deallocate network for instance.
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-70a4e05e-2eb7-4fc3-9c0f-bb22a5039f03 req-9c3ef3ec-f777-4689-b1ce-c64e0335f219 service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-deleted-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] Acquiring lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] No waiting events found dispatching network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:46 user nova-compute[74788]: WARNING nova.compute.manager [req-83faac83-b724-49de-a46c-d890253cb566 req-4e442141-d303-4d13-b88b-14f2b1a68f5f service nova] [instance: 3e877b14-1461-4307-8bc9-363e1efaaa94] Received unexpected event network-vif-plugged-077f52bb-2fa5-4f82-a470-9171cfe4ec62 for instance with vm_state deleted and task_state None.
Nov 08 15:17:46 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Deleted allocations for instance 3e877b14-1461-4307-8bc9-363e1efaaa94
Nov 08 15:17:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d8ae4998-22e7-492a-ab09-7f821144525d tempest-TestVolumeSwap-878514580 tempest-TestVolumeSwap-878514580-project-member] Lock "3e877b14-1461-4307-8bc9-363e1efaaa94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.845s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-changed-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing instance network info cache due to event network-changed-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:17:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] Acquiring lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:17:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] Acquired lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:17:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Refreshing network info cache for port 487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:17:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updated VIF entry in instance network info cache for port 487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:17:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-43a8cc8b-7da9-4d6d-975c-5f2342dd72e5 req-c7d119d6-1b94-41b1-ade2-9170ac259992 service nova] Releasing lock "refresh_cache-b89bfc12-601f-4fde-9d1f-3cc99469e9b8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:17:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:53 user nova-compute[74788]: INFO nova.compute.manager [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Terminating instance
Nov 08 15:17:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-unplugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] No waiting events found dispatching network-vif-unplugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-0a9070a1-dfe3-4fa2-8704-459ecb163803 req-1997bf4d-aa58-4a76-a610-f3faadc48324 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-unplugged-d62b0b42-b510-4a5d-ba8e-f126417897ff for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Instance destroyed successfully.
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lazy-loading 'resources' on Instance uuid 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-903341689',display_name='tempest-AttachSCSIVolumeTestJSON-server-903341689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-903341689',id=4,image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0fJmDYiWWbvcP41NcYlDaeXH0+1EpT6wy92TLlWxnX/3rgZun2cQeq7f2bPeSin/gysP8nFgqeF6xuwtbojXO8tBf8/n2+UwrY8QUl3oFNQWus1+0RxVxHFSkmnR/Dng==',key_name='tempest-keypair-400943787',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecbb9646cb224477b6f2a301c789af80',ramdisk_id='',reservation_id='r-qz7dvk4k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2084bf8e-c7ad-41a0-b25f-8d175e481e32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-20892047',owner_user_name='tempest-AttachSCSIVolumeTestJSON-20892047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50e3501913624bff879d18820e90e542',uuid=8880bfb1-f356-4e45-b6e8-06eba6d41cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converting VIF {"id": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "address": "fa:16:3e:de:a7:ee", "network": {"id": "89532fa9-aabe-4ac2-bf3c-72c07ca2583a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-651353895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbb9646cb224477b6f2a301c789af80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd62b0b42-b5", "ovs_interfaceid": "d62b0b42-b510-4a5d-ba8e-f126417897ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG os_vif [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd62b0b42-b5, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed059473-191a-4b0b-a82a-f7113cfe38b2) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:54 user nova-compute[74788]: INFO os_vif [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a7:ee,bridge_name='br-int',has_traffic_filtering=True,id=d62b0b42-b510-4a5d-ba8e-f126417897ff,network=Network(89532fa9-aabe-4ac2-bf3c-72c07ca2583a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd62b0b42-b5')
Nov 08 15:17:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Deleting instance files /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9_del
Nov 08 15:17:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Deletion of /opt/stack/data/nova/instances/8880bfb1-f356-4e45-b6e8-06eba6d41cf9_del complete
Nov 08 15:17:54 user nova-compute[74788]: INFO nova.compute.manager [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 15:17:54 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:17:54 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:55 user nova-compute[74788]: INFO nova.compute.manager [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Terminating instance
Nov 08 15:17:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-84631f98-d141-4886-a4ae-9fef1e289780 req-bea309bb-1869-4f6d-895f-a4b2f3c095b1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-c2a94f72-53fe-4003-b5c2-6ad25107317d req-18b805d2-db4e-4af4-9933-ed9738e31b30 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-deleted-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:56 user nova-compute[74788]: INFO nova.compute.manager [req-c2a94f72-53fe-4003-b5c2-6ad25107317d req-18b805d2-db4e-4af4-9933-ed9738e31b30 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Neutron deleted interface d62b0b42-b510-4a5d-ba8e-f126417897ff; detaching it from the instance and deleting it from the info cache
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-c2a94f72-53fe-4003-b5c2-6ad25107317d req-18b805d2-db4e-4af4-9933-ed9738e31b30 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:17:56 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Took 1.73 seconds to deallocate network for instance.
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-c2a94f72-53fe-4003-b5c2-6ad25107317d req-18b805d2-db4e-4af4-9933-ed9738e31b30 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Detach interface failed, port_id=d62b0b42-b510-4a5d-ba8e-f126417897ff, reason: Instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] Acquiring lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] No waiting events found dispatching network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:56 user nova-compute[74788]: WARNING nova.compute.manager [req-d65ca20d-5e86-4ff5-8117-53c421b0956e req-acfd1815-12d2-483e-a527-db747cbe0397 service nova] [instance: 8880bfb1-f356-4e45-b6e8-06eba6d41cf9] Received unexpected event network-vif-plugged-d62b0b42-b510-4a5d-ba8e-f126417897ff for instance with vm_state active and task_state deleting.
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:17:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:56 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Deleted allocations for instance 8880bfb1-f356-4e45-b6e8-06eba6d41cf9
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-48c5e8e9-949c-4c50-84c7-9a51fb15a67e tempest-AttachSCSIVolumeTestJSON-20892047 tempest-AttachSCSIVolumeTestJSON-20892047-project-member] Lock "8880bfb1-f356-4e45-b6e8-06eba6d41cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.962s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Instance destroyed successfully.
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.objects.instance [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lazy-loading 'resources' on Instance uuid b89bfc12-601f-4fde-9d1f-3cc99469e9b8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap487bbfb2-8b, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61917fe0-a3a3-4b29-b2d2-80598b98eecc) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:88:31,bridge_name='br-int',has_traffic_filtering=True,id=487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba,network=Network(5d96694f-4023-4178-9ccb-4fdb4baa50bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487bbfb2-8b')
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15dda27b-28, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c68794c-a7ac-4b41-a6ab-1d8b59b4fbd5) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:ed:48,bridge_name='br-int',has_traffic_filtering=True,id=15dda27b-28c1-4a9d-a0c2-0e2f99e5e584,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15dda27b-28')
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape45635a9-2c, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9db543a-7ff8-4d8f-a7a2-1985b9be421d) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:cd:15,bridge_name='br-int',has_traffic_filtering=True,id=e45635a9-2ce7-43c2-aad5-bb088282bfdf,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape45635a9-2c')
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2527fe3-33, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=379a72c2-e877-413d-bef7-fc41d80708cf) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:6c,bridge_name='br-int',has_traffic_filtering=True,id=e2527fe3-33e1-4798-8e1a-71f05e294af9,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2527fe3-33')
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap278b75c7-5e, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b86de64e-5244-4364-b75d-4fd976bdebc2) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba for instance with vm_state active and task_state deleting.
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING nova.compute.manager [req-8cfa17b2-35ca-490f-be33-203022fe3302 req-46a85bb3-2929-45e6-99cc-ebc86b1f0ec7 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e45635a9-2ce7-43c2-aad5-bb088282bfdf for instance with vm_state active and task_state deleting.
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b6:35,bridge_name='br-int',has_traffic_filtering=True,id=278b75c7-5eb7-4720-b102-da322c43d942,network=Network(75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278b75c7-5e')
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "address": "fa:16:3e:2b:46:00", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea7473f4-39", "ovs_interfaceid": "ea7473f4-3974-4b51-ba35-01c2b5bbb63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea7473f4-39, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28139e3e-ef02-4913-a5fc-cfc162f580a0) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:46:00,bridge_name='br-int',has_traffic_filtering=True,id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea7473f4-39')
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T15:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535354897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-535354897',id=9,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnE0BppT9Z+0xNdTTcJR2BigpfVfW2H2Mu15AsUHZGrv+2SK76F23av8QtMnFhgT3ImudVP7Se5SaDJhPOKmLzwG9FTgOU7smIlevC8E0jUk+mdSsQ02uFq/2Ljq1NHQQ==',key_name='tempest-keypair-103710174',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab888621e1234bd480d99e82e1725ee3',ramdisk_id='',reservation_id='r-d4mp940g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1143317820',owner_user_name='tempest-TaggedBootDevicesTest-1143317820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3908028027ad4e5c9dc89c44c467538e',uuid=b89bfc12-601f-4fde-9d1f-3cc99469e9b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converting VIF {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe5c07a-db, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=494cbaf7-3185-4626-870c-3a26b38e6105) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:17:58 user nova-compute[74788]: INFO os_vif [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:12,bridge_name='br-int',has_traffic_filtering=True,id=8fe5c07a-db64-46d0-92d1-789fe668bfb7,network=Network(4a0630c3-359d-4ed9-8394-c63e62ecfbc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe5c07a-db')
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TApeyDuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-15dda27b-28c1-4a9d-a0c2-0e2f99e5e584 for instance with vm_state active and task_state deleting.
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-278b75c7-5eb7-4720-b102-da322c43d942 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-278b75c7-5eb7-4720-b102-da322c43d942 for instance with vm_state active and task_state deleting.
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING nova.compute.manager [req-4c69b48e-df26-4d09-b88d-8d33275a6b90 req-9fd90383-344c-4981-a910-144c563c8767 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-ea7473f4-3974-4b51-ba35-01c2b5bbb63d for instance with vm_state active and task_state deleting.
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef68ba1-70aa-4a6a-8d4a-098ff54f35a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]: iSNS:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]: STATIC:
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:58 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:58 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41254354-6ef6-4e92-804c-77511af24d98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd2b5a-c5b7-422a-b280-3479ab17bef9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758468ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4'): ({'sdg'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Removing single pathed devices sdg {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf92d8a-eff8-47aa-bbe1-149ed2fec3b2]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e5f77-0700-4eeb-bf54-5b2d062d72e0]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Flushing IO for device /dev/sdg {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b500e2e9-9404-4ba9-8d14-71863369c300]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d396375f-99b2-4ecb-a757-378c5f8ad6e2]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] SCSI volumes sdg have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e489face-3101-46fd-ba30-6fc41285c90d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b177215-b80e-49f4-8c34-27cf192f8398]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260]
Nov 08 15:17:58 user nova-compute[74788]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c500d05-0bfc-42e7-9c57-0507d9e4ece4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fbef3-af63-416d-abca-971a1afe4e80]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== disconnect_volume: return (449ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UblkdPma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:58 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[346aa67b-b020-4e9a-af25-b04bffc284a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]: iSNS:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]: STATIC:
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:58 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:58 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:58 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:58 user nova-compute[74788]: No targets found.
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:58 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:58 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55e3908-7745-45a6-82be-4a4279b09b3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e49b86-5a6b-499f-8864-3a842060668a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758468ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b'): ({'sdk'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Removing single pathed devices sdk {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f19982-0ecb-44f1-b9bb-375c44f001be]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1acb66-253c-48a6-9b71-4ea6464b566d]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Flushing IO for device /dev/sdk {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67875fa0-ef65-4256-b843-8a8c2a6fb50f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[157827e4-5240-45ef-880b-981cab737dc7]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] SCSI volumes sdk have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95928a7-2eed-451e-a542-842369ed770c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47674a44-2fa7-43ac-845c-90da4b7a8238]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260]
Nov 08 15:17:59 user nova-compute[74788]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d3fdfe-f44b-4e17-8475-e195b5312b3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfb8ce5-5799-45a3-9710-992bbe0c1cb3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== disconnect_volume: return (403ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VlneyMUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:17:59 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[751e4794-a264-4e70-943f-2f31d0159ccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:17:59 user nova-compute[74788]: No targets found.
Nov 08 15:17:59 user nova-compute[74788]: iSNS:
Nov 08 15:17:59 user nova-compute[74788]: No targets found.
Nov 08 15:17:59 user nova-compute[74788]: STATIC:
Nov 08 15:17:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:17:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:17:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:17:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113
Nov 08 15:17:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:17:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:17:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:17:59 user nova-compute[74788]: FIRMWARE:
Nov 08 15:17:59 user nova-compute[74788]: No targets found.
Nov 08 15:17:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:17:59 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:17:59 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7b0f81-c0b7-4577-93bb-f4365dde6f26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8116a04-2ce9-49b6-aad2-8b01b6442f76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:17:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585820e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113'): ({'sde'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Removing single pathed devices sde {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e478fb-0ec7-4781-97ca-5628f7e8ba25]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fef5e-b139-4efb-bf8a-b1d380aac553]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Flushing IO for device /dev/sde {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a137a26-ba29-4b9d-8d59-6663e7b39a4f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0410b-908a-4bc9-ab3e-27349149d02b]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.072s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7845e4e-f28a-449b-a9f4-29429fc2e99c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[80515548-85fc-4c0f-85c9-2d5aadb0c1fd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260]
Nov 08 15:17:59 user nova-compute[74788]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113, portal: 172.16.0.220,3260] successful.
Nov 08 15:17:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066e3ee-9f47-4bd7-b38a-6162bea94113 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2ab89-befd-4c73-9bae-01ba8b555a45]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] <== disconnect_volume: return (413ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:17:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Deleting instance files /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8_del
Nov 08 15:17:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Deletion of /opt/stack/data/nova/instances/b89bfc12-601f-4fde-9d1f-3cc99469e9b8_del complete
Nov 08 15:17:59 user nova-compute[74788]: INFO nova.compute.manager [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Took 3.99 seconds to destroy the instance on the hypervisor.
Nov 08 15:17:59 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:17:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:00 user nova-compute[74788]: WARNING nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-e2527fe3-33e1-4798-8e1a-71f05e294af9 for instance with vm_state active and task_state deleting.
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-unplugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-unplugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Acquiring lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] No waiting events found dispatching network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:00 user nova-compute[74788]: WARNING nova.compute.manager [req-1c079df9-3aa4-4925-aba1-1c37f5fd23f1 req-7a1ec8ed-854a-49bc-aad6-61e6d17f6ad1 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received unexpected event network-vif-plugged-8fe5c07a-db64-46d0-92d1-789fe668bfb7 for instance with vm_state active and task_state deleting.
Nov 08 15:18:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Port 210c398c-b530-47f9-9e1b-e8d1b41f6389 binding to destination host user is already ACTIVE {{(pid=74788) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 15:18:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:18:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:18:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:18:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-39c7be23-7383-4a33-910a-0d4f1dbf1016 req-f8cc4384-3ab2-4918-8bd7-a1ec941cd4b0 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-deleted-ea7473f4-3974-4b51-ba35-01c2b5bbb63d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:01 user nova-compute[74788]: INFO nova.compute.manager [req-39c7be23-7383-4a33-910a-0d4f1dbf1016 req-f8cc4384-3ab2-4918-8bd7-a1ec941cd4b0 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Neutron deleted interface ea7473f4-3974-4b51-ba35-01c2b5bbb63d; detaching it from the instance and deleting it from the info cache
Nov 08 15:18:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-39c7be23-7383-4a33-910a-0d4f1dbf1016 req-f8cc4384-3ab2-4918-8bd7-a1ec941cd4b0 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [{"id": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "address": "fa:16:3e:05:88:31", "network": {"id": "5d96694f-4023-4178-9ccb-4fdb4baa50bd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141544297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487bbfb2-8b", "ovs_interfaceid": "487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "address": "fa:16:3e:97:ed:48", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dda27b-28", "ovs_interfaceid": "15dda27b-28c1-4a9d-a0c2-0e2f99e5e584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "address": "fa:16:3e:4c:cd:15", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45635a9-2c", "ovs_interfaceid": "e45635a9-2ce7-43c2-aad5-bb088282bfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "address": "fa:16:3e:b3:2b:6c", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2527fe3-33", "ovs_interfaceid": "e2527fe3-33e1-4798-8e1a-71f05e294af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "278b75c7-5eb7-4720-b102-da322c43d942", "address": "fa:16:3e:7c:b6:35", "network": {"id": "75bf70af-2aa0-4bc2-b3e7-3f1677aa39e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-523328650", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278b75c7-5e", "ovs_interfaceid": "278b75c7-5eb7-4720-b102-da322c43d942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "address": "fa:16:3e:0e:74:12", "network": {"id": "4a0630c3-359d-4ed9-8394-c63e62ecfbc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-746765390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab888621e1234bd480d99e82e1725ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe5c07a-db", "ovs_interfaceid": "8fe5c07a-db64-46d0-92d1-789fe668bfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-39c7be23-7383-4a33-910a-0d4f1dbf1016 req-f8cc4384-3ab2-4918-8bd7-a1ec941cd4b0 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Detach interface failed, port_id=ea7473f4-3974-4b51-ba35-01c2b5bbb63d, reason: Instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Creating tmpfile /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/tmpdyddjxo_ to verify with other compute node that the instance is on the same shared storage. {{(pid=74788) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:03 user nova-compute[74788]: WARNING nova.compute.manager [req-bc1597d0-c1f5-41ec-89aa-d78fdbdcb1e0 req-09ea2fbf-4809-44cf-a97a-6d124b2e9bb0 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state resized and task_state resize_reverting.
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance destroyed successfully.
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'resources' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210c398c-b5, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1163817a-0aba-4540-a176-eb030430a6b5) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:03 user nova-compute[74788]: INFO os_vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:03 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b73c82-bbbe-484c-9b08-290236a4726e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:18:03 user nova-compute[74788]: No targets found.
Nov 08 15:18:03 user nova-compute[74788]: iSNS:
Nov 08 15:18:03 user nova-compute[74788]: No targets found.
Nov 08 15:18:03 user nova-compute[74788]: STATIC:
Nov 08 15:18:03 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:18:03 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:03 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:03 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:18:03 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:03 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:03 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:18:03 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:03 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:03 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:18:03 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:03 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:03 user nova-compute[74788]: FIRMWARE:
Nov 08 15:18:03 user nova-compute[74788]: No targets found.
Nov 08 15:18:03 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:18:03 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:18:03 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b60009-8de4-4df1-a871-f375205122a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[663a0a32-8740-4079-a70d-e177c168ed7b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:03 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7797084280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980'): ({'sdl'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Removing single pathed devices sdl {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad9339d-ffeb-4e85-84a9-52a0a0e169c6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e6d0e-748f-42aa-a85b-b7006e2fb1db]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flushing IO for device /dev/sdl {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a2a16f-c288-4786-9da5-c1761f4f0df3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Took 3.97 seconds to deallocate network for instance.
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.049s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42843aec-0c3e-4a97-aa85-208721093c09]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] SCSI volumes sdl have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-52ddb621-2772-4e91-b0ef-087be6005e80 req-f5bf1485-52a0-451e-84f6-3afe96540999 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-deleted-8fe5c07a-db64-46d0-92d1-789fe668bfb7 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-52ddb621-2772-4e91-b0ef-087be6005e80 req-f5bf1485-52a0-451e-84f6-3afe96540999 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-deleted-e2527fe3-33e1-4798-8e1a-71f05e294af9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-52ddb621-2772-4e91-b0ef-087be6005e80 req-f5bf1485-52a0-451e-84f6-3afe96540999 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-deleted-278b75c7-5eb7-4720-b102-da322c43d942 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-52ddb621-2772-4e91-b0ef-087be6005e80 req-f5bf1485-52a0-451e-84f6-3afe96540999 service nova] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Received event network-vif-deleted-487bbfb2-8b2d-4ec9-9cb2-b39acd37a9ba {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14691a8-e7df-4abd-9bc8-b6b87aa474f2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8374d6-fb94-4a6c-a6c0-edf9cd1bd871]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:18:03 user nova-compute[74788]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:18:03 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c0990-a35f-45d2-8aff-28e0a1eda02f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== disconnect_volume: return (439ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:18:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysaQxVmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:04 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf2b634-c302-4791-b479-32511963214c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:18:04 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee7d860-e11e-4d36-b522-7b8d90b7341f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9] added
Nov 08 15:18:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479e5dc-3e5c-4a8f-9c31-19a293287a84]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5af62d-dd68-42e3-a6da-7284b556116a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysaQxVmK {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysaQxVmK" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ace05ec-23a9-45ae-8513-da72612d530c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ysaQxVmK'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7000beca-a97d-4288-b5e4-4a3a4f8a33e2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c5f13-956f-4657-877d-532684455b61]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'migration_context' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Object Instance<4d4cedbd-4e31-4aad-a580-da6aded0134f> lazy-loaded attributes: resources,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:05 user nova-compute[74788]: WARNING nova.compute.manager [req-05583152-9ee1-4cff-a4d4-887218d4fb22 req-f4ff8daa-1db4-4713-b17b-9fa09809fbb3 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state resized and task_state resize_reverting.
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b631320c-ed88-4dd0-9702-689bcc62a0ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260]
Nov 08 15:18:05 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260] successful.
Nov 08 15:18:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a111bc3b-1b36-4168-9dc9-a8190481ea9a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e76da-9d56-4941-85e4-781cb068d732]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)
Nov 08 15:18:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e216e8f5-7d69-4217-8557-00a338bacbb8]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysaQxVmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.436s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:05 user nova-compute[74788]: INFO nova.compute.manager [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Swapping old allocation on dict_keys(['e3449262-5ea3-41b5-a9f5-efda3df45537']) held by migration f92cff73-04ac-4f68-9ee5-9d18ef237e54 for instance
Nov 08 15:18:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Overwriting current allocation {'allocations': {'e3449262-5ea3-41b5-a9f5-efda3df45537': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 17}}, 'project_id': '4931b5b5c3724596ae964178f6683416', 'user_id': 'c4cd49810cc347279c7f97ab21bc9e36', 'consumer_generation': 1} on consumer 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23533653039336138', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533653039336138', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:18:06 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:06 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:18:06 user nova-compute[74788]:   <target dev="vdc" bus="virtio"/>
Nov 08 15:18:06 user nova-compute[74788]:   <serial>894f5da8-2694-4d9e-b79c-f9a9a9b996e9</serial>
Nov 08 15:18:06 user nova-compute[74788]: </disk>
Nov 08 15:18:06 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.utils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:06 user nova-compute[74788]: INFO nova.compute.manager [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] [instance: b89bfc12-601f-4fde-9d1f-3cc99469e9b8] Took 2.89 seconds to detach 3 volumes for instance.
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b8e5c-cf95-41d3-961a-7b11c560d17b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a027744-5c60-4711-ae4a-13c50166aa43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f89649-bda0-4068-8cd6-1ca03fbf19d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75608dc-d4f0-4ca8-814c-c5820cfef03f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:18:06 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56027e-4c17-4bbb-8f1e-fde14f81a8e3]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG os_brick.utils [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] No VIF found with MAC fa:16:3e:02:b2:66, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d4648004-4c72-4add-b398-1fc4a0a29909 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.458s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 28.793s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:07 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Deleted allocations for instance b89bfc12-601f-4fde-9d1f-3cc99469e9b8
Nov 08 15:18:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49643817-442a-4588-a774-5987d3233f7a tempest-TaggedBootDevicesTest-1143317820 tempest-TaggedBootDevicesTest-1143317820-project-member] Lock "b89bfc12-601f-4fde-9d1f-3cc99469e9b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.476s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:07 user nova-compute[74788]: INFO nova.compute.manager [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Detaching volume 894f5da8-2694-4d9e-b79c-f9a9a9b996e9
Nov 08 15:18:07 user nova-compute[74788]: INFO nova.virt.block_device [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attempting to driver detach volume 894f5da8-2694-4d9e-b79c-f9a9a9b996e9 from mountpoint /dev/vdc
Nov 08 15:18:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Attempting to detach device vdc from instance 9357621e-cd81-491a-87ac-803f576688c2 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:18:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:07 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:07 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:18:07 user nova-compute[74788]:   <target dev="vdc" bus="virtio"/>
Nov 08 15:18:07 user nova-compute[74788]:   <serial>894f5da8-2694-4d9e-b79c-f9a9a9b996e9</serial>
Nov 08 15:18:07 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 15:18:07 user nova-compute[74788]: </disk>
Nov 08 15:18:07 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully detached device vdc from instance 9357621e-cd81-491a-87ac-803f576688c2 from the persistent domain config.
Nov 08 15:18:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9357621e-cd81-491a-87ac-803f576688c2 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:18:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:07 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:07 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:18:07 user nova-compute[74788]:   <target dev="vdc" bus="virtio"/>
Nov 08 15:18:07 user nova-compute[74788]:   <serial>894f5da8-2694-4d9e-b79c-f9a9a9b996e9</serial>
Nov 08 15:18:07 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 15:18:07 user nova-compute[74788]: </disk>
Nov 08 15:18:07 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:18:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:20 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:18:20 user nova-compute[74788]: INFO nova.compute.claims [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Claim successful on node user
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:18:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.policy [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9364a17762748f3a27b326ad597b5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cd17a9a5cd463ea901bc494dec7a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:18:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Creating image(s)
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "/opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "/opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "/opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk 1073741824" returned: 0 in 0.052s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Successfully created port: 56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Cannot resize image /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Ensure instance console log exists: /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Successfully updated port: 56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquired lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-changed-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Refreshing instance network info cache due to event network-changed-56602e5f-259d-4910-a8ee-4b90567087a2. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] Acquiring lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updating instance_info_cache with network_info: [{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Releasing lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Instance network_info: |[{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] Acquired lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Refreshing network info cache for port 56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Start _get_guest_xml network_info=[{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:18:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1837873673',display_name='tempest-ServersNegativeTestJSON-server-1837873673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1837873673',id=14,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-mnuo37rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:18:21Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=69234b99-1d52-4ea3-a371-b36804e3c314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lazy-loading 'pci_devices' on Instance uuid 69234b99-1d52-4ea3-a371-b36804e3c314 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:18:23 user nova-compute[74788]:   <uuid>69234b99-1d52-4ea3-a371-b36804e3c314</uuid>
Nov 08 15:18:23 user nova-compute[74788]:   <name>instance-0000000e</name>
Nov 08 15:18:23 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:18:23 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:18:23 user nova-compute[74788]:   <metadata>
Nov 08 15:18:23 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:18:23 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:name>tempest-ServersNegativeTestJSON-server-1837873673</nova:name>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:18:23</nova:creationTime>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:18:23 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:18:23 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:owner>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:user uuid="d9364a17762748f3a27b326ad597b5c0">tempest-ServersNegativeTestJSON-1624352802-project-member</nova:user>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:project uuid="e3cd17a9a5cd463ea901bc494dec7a78">tempest-ServersNegativeTestJSON-1624352802</nova:project>
Nov 08 15:18:23 user nova-compute[74788]:       </nova:owner>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:18:23 user nova-compute[74788]:       <nova:ports>
Nov 08 15:18:23 user nova-compute[74788]:         <nova:port uuid="56602e5f-259d-4910-a8ee-4b90567087a2">
Nov 08 15:18:23 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:18:23 user nova-compute[74788]:         </nova:port>
Nov 08 15:18:23 user nova-compute[74788]:       </nova:ports>
Nov 08 15:18:23 user nova-compute[74788]:     </nova:instance>
Nov 08 15:18:23 user nova-compute[74788]:   </metadata>
Nov 08 15:18:23 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:18:23 user nova-compute[74788]:     <system>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="serial">69234b99-1d52-4ea3-a371-b36804e3c314</entry>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="uuid">69234b99-1d52-4ea3-a371-b36804e3c314</entry>
Nov 08 15:18:23 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:18:23 user nova-compute[74788]:     </system>
Nov 08 15:18:23 user nova-compute[74788]:   </sysinfo>
Nov 08 15:18:23 user nova-compute[74788]:   <os>
Nov 08 15:18:23 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:18:23 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:18:23 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:18:23 user nova-compute[74788]:   </os>
Nov 08 15:18:23 user nova-compute[74788]:   <features>
Nov 08 15:18:23 user nova-compute[74788]:     <acpi/>
Nov 08 15:18:23 user nova-compute[74788]:     <apic/>
Nov 08 15:18:23 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:18:23 user nova-compute[74788]:   </features>
Nov 08 15:18:23 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:18:23 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:18:23 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:18:23 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:18:23 user nova-compute[74788]:   </clock>
Nov 08 15:18:23 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:18:23 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:18:23 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:18:23 user nova-compute[74788]:   </cpu>
Nov 08 15:18:23 user nova-compute[74788]:   <devices>
Nov 08 15:18:23 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:18:23 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:18:23 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk"/>
Nov 08 15:18:23 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:18:23 user nova-compute[74788]:     </disk>
Nov 08 15:18:23 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:18:23 user nova-compute[74788]:       <mac address="fa:16:3e:84:b2:fa"/>
Nov 08 15:18:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:18:23 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:18:23 user nova-compute[74788]:       <target dev="tap56602e5f-25"/>
Nov 08 15:18:23 user nova-compute[74788]:     </interface>
Nov 08 15:18:23 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:18:23 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/console.log" append="off"/>
Nov 08 15:18:23 user nova-compute[74788]:     </serial>
Nov 08 15:18:23 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:18:23 user nova-compute[74788]:     <video>
Nov 08 15:18:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:18:23 user nova-compute[74788]:     </video>
Nov 08 15:18:23 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:18:23 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:18:23 user nova-compute[74788]:     </rng>
Nov 08 15:18:23 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:18:23 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:18:23 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:18:23 user nova-compute[74788]:     </memballoon>
Nov 08 15:18:23 user nova-compute[74788]:   </devices>
Nov 08 15:18:23 user nova-compute[74788]: </domain>
Nov 08 15:18:23 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1837873673',display_name='tempest-ServersNegativeTestJSON-server-1837873673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1837873673',id=14,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-mnuo37rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:18:21Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=69234b99-1d52-4ea3-a371-b36804e3c314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG os_vif [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3bfa38b-ac26-5a3d-a766-742b1b3a1312', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56602e5f-25, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56602e5f-25, col_values=(('qos', UUID('34697135-8ecb-4f21-8262-4fdc42d2c2e8')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56602e5f-25, col_values=(('external_ids', {'iface-id': '56602e5f-259d-4910-a8ee-4b90567087a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:b2:fa', 'vm-uuid': '69234b99-1d52-4ea3-a371-b36804e3c314'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:23 user nova-compute[74788]: INFO os_vif [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25')
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:18:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] No VIF found with MAC fa:16:3e:84:b2:fa, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:18:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updated VIF entry in instance network info cache for port 56602e5f-259d-4910-a8ee-4b90567087a2. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:18:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updating instance_info_cache with network_info: [{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c72cfceb-ac6b-491e-874f-bdf0da8fe9fa req-26e4f5bb-e566-43f4-bf94-dd37acf57a4b service nova] Releasing lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] No waiting events found dispatching network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:25 user nova-compute[74788]: WARNING nova.compute.manager [req-ad0b61c6-2cec-45eb-946b-ba9cfc122550 req-7a480564-6f8a-4795-af53-f4ccf9104290 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received unexpected event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 for instance with vm_state building and task_state spawning.
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] No waiting events found dispatching network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:27 user nova-compute[74788]: WARNING nova.compute.manager [req-4f785c41-e969-4c2a-a1ab-763c2b82e511 req-ee4d856f-23e0-4f07-a3b8-c716930743b7 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received unexpected event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 for instance with vm_state building and task_state spawning.
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:18:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Instance spawned successfully.
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:18:27 user nova-compute[74788]: INFO nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 08 15:18:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:18:27 user nova-compute[74788]: INFO nova.compute.manager [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Took 6.89 seconds to build instance.
Nov 08 15:18:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6e5cde37-d691-4049-91ca-209fc1787778 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.037s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:28 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9357621e-cd81-491a-87ac-803f576688c2 is timed out.
Nov 08 15:18:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully detached device vdc from instance 9357621e-cd81-491a-87ac-803f576688c2 from the live domain config.
Nov 08 15:18:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysaQxVmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:28 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[76169c72-2dfc-46a8-8398-4a04b9fae278]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:18:28 user nova-compute[74788]: No targets found.
Nov 08 15:18:28 user nova-compute[74788]: iSNS:
Nov 08 15:18:28 user nova-compute[74788]: No targets found.
Nov 08 15:18:28 user nova-compute[74788]: STATIC:
Nov 08 15:18:28 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9
Nov 08 15:18:28 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:28 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:28 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:18:28 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:28 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:28 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:18:28 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:28 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:28 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:18:28 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:28 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:28 user nova-compute[74788]: FIRMWARE:
Nov 08 15:18:28 user nova-compute[74788]: No targets found.
Nov 08 15:18:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:18:28 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:18:28 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82091b-2cd5-477c-a671-271a91e6d805]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd243f0-0995-49b3-a164-56cf2f382d29]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 (non-flash)
Nov 08 15:18:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585cd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173a24d-a7fb-45c2-b6c7-3e099a5497e4]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1f863-26c5-4a49-83e8-8bde4bfcf0ca]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d38c1e-012a-4cb7-9af6-6706305475c6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ca2ab-95b7-4847-a5ab-a00e5c47ed50]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d1fce-46a7-451c-8ea9-6a479fdc7883]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3fb938-13e5-4be7-863b-804dcbf2e1ad]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260]
Nov 08 15:18:28 user nova-compute[74788]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9, portal: 172.16.0.220,3260] successful.
Nov 08 15:18:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894f5da8-2694-4d9e-b79c-f9a9a9b996e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9d62e-51f5-45bc-874d-473be110eab9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== disconnect_volume: return (338ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:18:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:29 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8a79d545-7a35-4116-820d-a0abb9e012f0 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.996s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Starting finish_revert_migration {{(pid=74788) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start _get_guest_xml network_info=[{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4d4cedbd-4e31-4aad-a580-da6aded0134f', 'attached_at': '2023-11-08T15:18:32.000000', 'detached_at': '', 'volume_id': 'edb139de-2a58-465f-8eb8-607ab11ae980', 'serial': 'edb139de-2a58-465f-8eb8-607ab11ae980'}, 'attachment_id': 'f2cfc061-0da8-4bbd-85a8-1ad796b0ac44', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:18:31 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:31 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.objects.instance [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:31 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:31 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:31 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e07e1-b297-4fa5-a152-ab4cfadc7c31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:18:31 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac774ad-6c76-4293-bcc2-a13a9f86f8fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980] added
Nov 08 15:18:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e092343a-a59f-4232-90bb-f0c98ca9f0de]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ed7e1-16ad-4e9b-82a6-0541646efdb7]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojykunta" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d01b31f-0048-4f5a-8677-fa67240c43d5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojykunta'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[465233aa-cfa6-4908-badd-8accf548f233]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4237ba-122f-4d25-82ae-599ae5e29615]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a9dfb-8d67-480b-859a-edcf66a638b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:18:32 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:18:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b90db6-23f9-43b3-aa50-c5a1934d57b9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[19466560-cee2-4a63-a811-5a8f9ec839dd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9c66aa-f18c-4dd0-a661-bf148b40a593]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735626366626431', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:18:33 user nova-compute[74788]:   <uuid>4d4cedbd-4e31-4aad-a580-da6aded0134f</uuid>
Nov 08 15:18:33 user nova-compute[74788]:   <name>instance-00000001</name>
Nov 08 15:18:33 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:18:33 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:18:33 user nova-compute[74788]:   <metadata>
Nov 08 15:18:33 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:18:33 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherB-server-1076661114</nova:name>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:18:31</nova:creationTime>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:18:33 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:18:33 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:owner>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:user uuid="c4cd49810cc347279c7f97ab21bc9e36">tempest-ServerActionsTestOtherB-108483217-project-member</nova:user>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:project uuid="4931b5b5c3724596ae964178f6683416">tempest-ServerActionsTestOtherB-108483217</nova:project>
Nov 08 15:18:33 user nova-compute[74788]:       </nova:owner>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:18:33 user nova-compute[74788]:       <nova:ports>
Nov 08 15:18:33 user nova-compute[74788]:         <nova:port uuid="210c398c-b530-47f9-9e1b-e8d1b41f6389">
Nov 08 15:18:33 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:18:33 user nova-compute[74788]:         </nova:port>
Nov 08 15:18:33 user nova-compute[74788]:       </nova:ports>
Nov 08 15:18:33 user nova-compute[74788]:     </nova:instance>
Nov 08 15:18:33 user nova-compute[74788]:   </metadata>
Nov 08 15:18:33 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:18:33 user nova-compute[74788]:     <system>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="serial">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="uuid">4d4cedbd-4e31-4aad-a580-da6aded0134f</entry>
Nov 08 15:18:33 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:18:33 user nova-compute[74788]:     </system>
Nov 08 15:18:33 user nova-compute[74788]:   </sysinfo>
Nov 08 15:18:33 user nova-compute[74788]:   <os>
Nov 08 15:18:33 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:18:33 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:18:33 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:18:33 user nova-compute[74788]:   </os>
Nov 08 15:18:33 user nova-compute[74788]:   <features>
Nov 08 15:18:33 user nova-compute[74788]:     <acpi/>
Nov 08 15:18:33 user nova-compute[74788]:     <apic/>
Nov 08 15:18:33 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:18:33 user nova-compute[74788]:   </features>
Nov 08 15:18:33 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:18:33 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:18:33 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:18:33 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:18:33 user nova-compute[74788]:   </clock>
Nov 08 15:18:33 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:18:33 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:18:33 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:18:33 user nova-compute[74788]:   </cpu>
Nov 08 15:18:33 user nova-compute[74788]:   <devices>
Nov 08 15:18:33 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:18:33 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:18:33 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk"/>
Nov 08 15:18:33 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:18:33 user nova-compute[74788]:     </disk>
Nov 08 15:18:33 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:18:33 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:33 user nova-compute[74788]:       <source dev="/dev/sdd"/>
Nov 08 15:18:33 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:18:33 user nova-compute[74788]:       <serial>edb139de-2a58-465f-8eb8-607ab11ae980</serial>
Nov 08 15:18:33 user nova-compute[74788]:     </disk>
Nov 08 15:18:33 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:18:33 user nova-compute[74788]:       <mac address="fa:16:3e:31:6b:13"/>
Nov 08 15:18:33 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:18:33 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:18:33 user nova-compute[74788]:       <target dev="tap210c398c-b5"/>
Nov 08 15:18:33 user nova-compute[74788]:     </interface>
Nov 08 15:18:33 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:18:33 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/console.log" append="off"/>
Nov 08 15:18:33 user nova-compute[74788]:     </serial>
Nov 08 15:18:33 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:18:33 user nova-compute[74788]:     <video>
Nov 08 15:18:33 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:18:33 user nova-compute[74788]:     </video>
Nov 08 15:18:33 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:18:33 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:18:33 user nova-compute[74788]:     </rng>
Nov 08 15:18:33 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:18:33 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:18:33 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:18:33 user nova-compute[74788]:     </memballoon>
Nov 08 15:18:33 user nova-compute[74788]:   </devices>
Nov 08 15:18:33 user nova-compute[74788]: </domain>
Nov 08 15:18:33 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG os_vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc4a5a5-ebd3-55c5-9d8c-9f1b6117bd78', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap210c398c-b5, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap210c398c-b5, col_values=(('qos', UUID('5ca0fd7d-695f-4115-8ac6-b01fec990f40')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap210c398c-b5, col_values=(('external_ids', {'iface-id': '210c398c-b530-47f9-9e1b-e8d1b41f6389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:6b:13', 'vm-uuid': '4d4cedbd-4e31-4aad-a580-da6aded0134f'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:33 user nova-compute[74788]: INFO os_vif [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:18:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:34 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:35 user nova-compute[74788]: WARNING nova.compute.manager [req-5f4e3d16-0b11-4698-ae51-fb553b3d192a req-d284a662-a085-4580-97f7-c9d407878f33 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state resized and task_state resize_reverting.
Nov 08 15:18:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:18:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance running successfully.
Nov 08 15:18:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] finish_revert_migration finished successfully. {{(pid=74788) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:37 user nova-compute[74788]: WARNING nova.compute.manager [req-4fc1da74-4bf5-4c3f-9d57-917cee6ff444 req-a51bfb41-8d2f-4cbd-a9f6-b5574baeb49c service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state resized and task_state resize_reverting.
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:37 user nova-compute[74788]: INFO nova.compute.manager [None req-db71c1d9-fcc5-4e0a-9984-4d09347b8f6c tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance to original state: 'active'
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:38 user nova-compute[74788]: INFO nova.compute.manager [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Terminating instance
Nov 08 15:18:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:18:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-df8c2bde-fd95-4b47-a483-b634295e1439 req-31372fbe-962c-4c1e-9125-9baef7805892 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-unplugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:18:39 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Instance destroyed successfully.
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.objects.instance [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lazy-loading 'resources' on Instance uuid 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:12:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1431378698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1566444936',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdB4QEHNM3hvWOTm4P7yZMReYK0g397Ky4g3sulU1wdO/o8ou9IpitNdRahhuRrBKWOAIIxzcGr3HhlarWuqjpGdr6eLO7uT9iUxWEWXuRM7XsZbvtNqOiBUyXiznQqug==',key_name='tempest-keypair-152396955',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbd9e29971b9494cae915e79db86fa47',ramdisk_id='',reservation_id='r-oja9nl6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497590387',owner_user_name='tempest-ServerActionsV293TestJSON-1497590387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc01abecef094ba7a60598071aef302d',uuid=8defda1b-5de4-4d07-8d5c-8fd1b26333b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converting VIF {"id": "aba69107-b8dd-4250-b080-574b0a47c91f", "address": "fa:16:3e:e4:13:36", "network": {"id": "62bd0e19-75ee-410c-a148-c369a4fd71b5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-64943788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbd9e29971b9494cae915e79db86fa47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba69107-b8", "ovs_interfaceid": "aba69107-b8dd-4250-b080-574b0a47c91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_vif [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaba69107-b8, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a09ccba7-7b3d-4247-9d71-dc44060adf90) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:39 user nova-compute[74788]: INFO os_vif [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:13:36,bridge_name='br-int',has_traffic_filtering=True,id=aba69107-b8dd-4250-b080-574b0a47c91f,network=Network(62bd0e19-75ee-410c-a148-c369a4fd71b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba69107-b8')
Nov 08 15:18:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvKUlEFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:18:39 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb38c7-bf31-426d-a470-0dbb068ac2dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:18:39 user nova-compute[74788]: No targets found.
Nov 08 15:18:39 user nova-compute[74788]: iSNS:
Nov 08 15:18:39 user nova-compute[74788]: No targets found.
Nov 08 15:18:39 user nova-compute[74788]: STATIC:
Nov 08 15:18:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901
Nov 08 15:18:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:18:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:18:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:18:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:18:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:18:39 user nova-compute[74788]: FIRMWARE:
Nov 08 15:18:39 user nova-compute[74788]: No targets found.
Nov 08 15:18:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:18:39 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:18:39 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca4c84-b03d-4868-9d23-54251ce59320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b2d3b-dc39-4b24-b7d5-37fa538be5d1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:18:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77584888b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901'): ({'sdj'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Removing single pathed devices sdj {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67041165-0927-4515-a163-5e238ddcc649]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf1ef5f-2c05-4108-b9d0-b103228db01f]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Flushing IO for device /dev/sdj {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bbb980-052b-4c82-aa1c-838359381ad0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:18:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b289de-a7a8-4d0a-8cec-d2b7699d57f6]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] SCSI volumes sdj have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd95489-1997-4e0a-8e2e-5726a8e91167]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad87dbb9-d873-4cdd-bed0-a7130eda827b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260]
Nov 08 15:18:40 user nova-compute[74788]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901, portal: 172.16.0.220,3260] successful.
Nov 08 15:18:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5251fd-3275-45d8-994c-180882761901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[365276b1-4fd7-4dc6-a24f-1d34d51f897f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] <== disconnect_volume: return (472ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:18:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deleting instance files /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5_del
Nov 08 15:18:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deletion of /opt/stack/data/nova/instances/8defda1b-5de4-4d07-8d5c-8fd1b26333b5_del complete
Nov 08 15:18:40 user nova-compute[74788]: INFO nova.compute.manager [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Took 1.81 seconds to destroy the instance on the hypervisor.
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] Acquiring lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] No waiting events found dispatching network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:41 user nova-compute[74788]: WARNING nova.compute.manager [req-97722a0a-2b9e-4f7f-bcfd-89a2faa5ae75 req-74372b8e-99f3-4d6b-a3b1-5741cf91ed2f service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received unexpected event network-vif-plugged-aba69107-b8dd-4250-b080-574b0a47c91f for instance with vm_state active and task_state deleting.
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.57537078857422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:41 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Took 1.34 seconds to deallocate network for instance.
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9357621e-cd81-491a-87ac-803f576688c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance a6743784-823a-4c49-adf0-6bdb4a30b476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance bf5695e6-02aa-4093-a556-a62e367b5925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:18:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-90e5b6f3-0081-470d-ba50-c7d548e050a4 req-3a41dbf6-b681-4648-b58e-65f1dad3dad0 service nova] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Received event network-vif-deleted-aba69107-b8dd-4250-b080-574b0a47c91f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:42 user nova-compute[74788]: INFO nova.compute.manager [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Took 1.00 seconds to detach 1 volumes for instance.
Nov 08 15:18:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] [instance: 8defda1b-5de4-4d07-8d5c-8fd1b26333b5] Deleting volume: 2b5251fd-3275-45d8-994c-180882761901 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:18:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:18:43 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Deleted allocations for instance 8defda1b-5de4-4d07-8d5c-8fd1b26333b5
Nov 08 15:18:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-63bd4341-b81d-48f8-8dc4-ccef4bef9977 tempest-ServerActionsV293TestJSON-1497590387 tempest-ServerActionsV293TestJSON-1497590387-project-member] Lock "8defda1b-5de4-4d07-8d5c-8fd1b26333b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.875s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:46 user nova-compute[74788]: INFO nova.compute.manager [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Detaching volume 2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:18:46 user nova-compute[74788]: INFO nova.virt.block_device [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Attempting to driver detach volume 2d247311-d76c-4f7f-8cfe-858866681f85 from mountpoint /dev/vdb
Nov 08 15:18:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Attempting to detach device vdb from instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:18:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:46 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:46 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:18:46 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:18:46 user nova-compute[74788]:   <serial>2d247311-d76c-4f7f-8cfe-858866681f85</serial>
Nov 08 15:18:46 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:18:46 user nova-compute[74788]: </disk>
Nov 08 15:18:46 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully detached device vdb from instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e from the persistent domain config.
Nov 08 15:18:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:18:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:46 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:46 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:18:46 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:18:46 user nova-compute[74788]:   <serial>2d247311-d76c-4f7f-8cfe-858866681f85</serial>
Nov 08 15:18:46 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:18:46 user nova-compute[74788]: </disk>
Nov 08 15:18:46 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:18:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:55 user nova-compute[74788]: INFO nova.compute.manager [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Terminating instance
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-unplugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-unplugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-1fe23e2c-b586-4115-bd71-f34f7ecda69e req-45dadb91-67bd-4fe4-8c26-e533312adc74 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-unplugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Instance destroyed successfully.
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.objects.instance [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'resources' on Instance uuid a6743784-823a-4c49-adf0-6bdb4a30b476 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1148287710',display_name='tempest-VolumesAdminNegativeTest-server-1148287710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1148287710',id=12,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-63x4fgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:16:56Z,user_data=None,user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=a6743784-823a-4c49-adf0-6bdb4a30b476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "5332d621-f5f3-4d74-b160-8c5d8df07812", "address": "fa:16:3e:44:f1:1e", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5332d621-f5", "ovs_interfaceid": "5332d621-f5f3-4d74-b160-8c5d8df07812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG os_vif [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5332d621-f5, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f41dc18-d3cf-4ced-b62d-0fe0baf02988) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:18:55 user nova-compute[74788]: INFO os_vif [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f1:1e,bridge_name='br-int',has_traffic_filtering=True,id=5332d621-f5f3-4d74-b160-8c5d8df07812,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5332d621-f5')
Nov 08 15:18:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Deleting instance files /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476_del
Nov 08 15:18:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Deletion of /opt/stack/data/nova/instances/a6743784-823a-4c49-adf0-6bdb4a30b476_del complete
Nov 08 15:18:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:55 user nova-compute[74788]: INFO nova.compute.manager [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 15:18:55 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:18:55 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:18:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:57 user nova-compute[74788]: WARNING nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state active and task_state deleting.
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:57 user nova-compute[74788]: WARNING nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state active and task_state deleting.
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:57 user nova-compute[74788]: WARNING nova.compute.manager [req-17422d00-abbb-4885-b9eb-14f77c22a2a6 req-1d92d09c-5612-46ef-8a3d-caa7a3ea7778 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state active and task_state deleting.
Nov 08 15:18:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:18:57 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Took 1.79 seconds to deallocate network for instance.
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:58 user nova-compute[74788]: INFO nova.compute.manager [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Detaching volume fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:18:58 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Deleted allocations for instance a6743784-823a-4c49-adf0-6bdb4a30b476
Nov 08 15:18:58 user nova-compute[74788]: INFO nova.virt.block_device [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Attempting to driver detach volume fc8d7ace-0c3b-447b-94dc-60cbcceceb92 from mountpoint /dev/vdb
Nov 08 15:18:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47a40752-7840-44d7-8335-5149f1c0e408 tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Attempting to detach device vdb from instance 9357621e-cd81-491a-87ac-803f576688c2 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:58 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:58 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:18:58 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:18:58 user nova-compute[74788]:   <serial>fc8d7ace-0c3b-447b-94dc-60cbcceceb92</serial>
Nov 08 15:18:58 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:18:58 user nova-compute[74788]: </disk>
Nov 08 15:18:58 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully detached device vdb from instance 9357621e-cd81-491a-87ac-803f576688c2 from the persistent domain config.
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9357621e-cd81-491a-87ac-803f576688c2 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:18:58 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:18:58 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:18:58 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:18:58 user nova-compute[74788]:   <serial>fc8d7ace-0c3b-447b-94dc-60cbcceceb92</serial>
Nov 08 15:18:58 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:18:58 user nova-compute[74788]: </disk>
Nov 08 15:18:58 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:18:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:18:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:18:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] Acquiring lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:18:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:18:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] Lock "a6743784-823a-4c49-adf0-6bdb4a30b476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:18:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] No waiting events found dispatching network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:18:59 user nova-compute[74788]: WARNING nova.compute.manager [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received unexpected event network-vif-plugged-5332d621-f5f3-4d74-b160-8c5d8df07812 for instance with vm_state deleted and task_state None.
Nov 08 15:18:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-d2dacea9-5533-4a59-b56d-8839c1d2db55 req-a737e57b-f80d-4796-9b79-12bb2fc59f75 service nova] [instance: a6743784-823a-4c49-adf0-6bdb4a30b476] Received event network-vif-deleted-5332d621-f5f3-4d74-b160-8c5d8df07812 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:06 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e is timed out.
Nov 08 15:19:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully detached device vdb from instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e from the live domain config.
Nov 08 15:19:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HplrVbMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:19:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a362391-4ddf-45c2-9e48-1293138c6dad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:19:06 user nova-compute[74788]: No targets found.
Nov 08 15:19:06 user nova-compute[74788]: iSNS:
Nov 08 15:19:06 user nova-compute[74788]: No targets found.
Nov 08 15:19:06 user nova-compute[74788]: STATIC:
Nov 08 15:19:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:19:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:19:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:19:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85
Nov 08 15:19:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:19:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:19:06 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:19:06 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:19:06 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:19:06 user nova-compute[74788]: FIRMWARE:
Nov 08 15:19:06 user nova-compute[74788]: No targets found.
Nov 08 15:19:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:19:06 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:19:06 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00bc58e-3b51-4f3a-be80-c0413f0a3419]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be5e61c-2642-4ca2-8611-0e014a53eeac]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:19:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758577490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d45a3-d751-47a0-975d-aec74e72d586]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1beb674-10b5-481c-9e67-7a905695ac43]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3151c6-2457-4452-ba6c-81df11fe23a5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:19:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5630a17-e898-46d8-8950-ad980525ab7f]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6eb8cf-f604-4de9-880c-f03f9f40833a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4527d443-0b47-40fb-89f0-3f76f199c678]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260]
Nov 08 15:19:07 user nova-compute[74788]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85, portal: 172.16.0.220,3260] successful.
Nov 08 15:19:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d247311-d76c-4f7f-8cfe-858866681f85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b1ce6-dd11-4b63-adff-026ce64d5847]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== disconnect_volume: return (350ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:19:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8ccf23e0-c485-4b6f-a944-9784e5f6e586 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.144s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74788) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance destroyed successfully.
Nov 08 15:19:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:19:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8d6a35fc-e4ae-475e-8af7-66d85834d5b3 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.983s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:12 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:19:12 user nova-compute[74788]: INFO nova.compute.claims [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Claim successful on node user
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:19:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.policy [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30bfaf63a8bf4172b0a72ee8536a76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c097c366f91c496e9f5a4cfaff0e14c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:19:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Creating image(s)
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.283s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk 1073741824" returned: 0 in 0.057s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.216s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Cannot resize image /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Ensure instance console log exists: /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:15 user nova-compute[74788]: WARNING nova.compute.manager [req-e2596769-106b-4baa-ada0-5a9e6a3ea2bc req-3a80ffbf-4fa6-43db-8edb-64c6ae7c28f5 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state None.
Nov 08 15:19:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Successfully created port: 384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:17 user nova-compute[74788]: WARNING nova.compute.manager [req-18d4776a-9816-43d7-ab61-0a7cd2b237f8 req-068c3f69-168a-4a7d-882f-7b3ca0dda444 service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state None.
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Successfully updated port: 384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:18 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9357621e-cd81-491a-87ac-803f576688c2 is timed out.
Nov 08 15:19:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully detached device vdb from instance 9357621e-cd81-491a-87ac-803f576688c2 from the live domain config.
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItapTxEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:19:18 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3cf762-a9ea-4986-8914-78173d8856ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:19:18 user nova-compute[74788]: No targets found.
Nov 08 15:19:18 user nova-compute[74788]: iSNS:
Nov 08 15:19:18 user nova-compute[74788]: No targets found.
Nov 08 15:19:18 user nova-compute[74788]: STATIC:
Nov 08 15:19:18 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92
Nov 08 15:19:18 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:19:18 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:19:18 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:19:18 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:19:18 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:19:18 user nova-compute[74788]: FIRMWARE:
Nov 08 15:19:18 user nova-compute[74788]: No targets found.
Nov 08 15:19:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:19:18 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:19:18 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae1849-2776-4c12-926b-76a268004289]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c853f-1e85-42c7-b7c1-0fb64446a587]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:19:18 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:19:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 (non-flash)
Nov 08 15:19:18 user nova-compute[74788]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:19:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585ad990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b8823-c898-493f-9c34-2f1957eb0b8f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37e83c3-298d-424c-af50-40d88e46a80b]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e17c0c-51d6-4cf6-8f3d-514b1cd28261]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Instance network_info: |[{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:19:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Start _get_guest_xml network_info=[{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:19:18 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:18 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-808333465',display_name='tempest-ServerActionsTestOtherA-server-808333465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-808333465',id=15,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-ah2d0bp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=e0c3ad12-7047-4836-9f7b-c80a95aeeac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'pci_devices' on Instance uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec644c4-aeb4-4429-bfdc-c039baa16837]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:19:19 user nova-compute[74788]:   <uuid>e0c3ad12-7047-4836-9f7b-c80a95aeeac6</uuid>
Nov 08 15:19:19 user nova-compute[74788]:   <name>instance-0000000f</name>
Nov 08 15:19:19 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:19:19 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:19:19 user nova-compute[74788]:   <metadata>
Nov 08 15:19:19 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:19:19 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherA-server-808333465</nova:name>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:19:18</nova:creationTime>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:19:19 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:19:19 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:owner>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:user uuid="30bfaf63a8bf4172b0a72ee8536a76b2">tempest-ServerActionsTestOtherA-27641552-project-member</nova:user>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:project uuid="c097c366f91c496e9f5a4cfaff0e14c6">tempest-ServerActionsTestOtherA-27641552</nova:project>
Nov 08 15:19:19 user nova-compute[74788]:       </nova:owner>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:19:19 user nova-compute[74788]:       <nova:ports>
Nov 08 15:19:19 user nova-compute[74788]:         <nova:port uuid="384c3842-8fb5-435d-8451-91efba79f9b8">
Nov 08 15:19:19 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:19:19 user nova-compute[74788]:         </nova:port>
Nov 08 15:19:19 user nova-compute[74788]:       </nova:ports>
Nov 08 15:19:19 user nova-compute[74788]:     </nova:instance>
Nov 08 15:19:19 user nova-compute[74788]:   </metadata>
Nov 08 15:19:19 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:19:19 user nova-compute[74788]:     <system>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="serial">e0c3ad12-7047-4836-9f7b-c80a95aeeac6</entry>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="uuid">e0c3ad12-7047-4836-9f7b-c80a95aeeac6</entry>
Nov 08 15:19:19 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:19:19 user nova-compute[74788]:     </system>
Nov 08 15:19:19 user nova-compute[74788]:   </sysinfo>
Nov 08 15:19:19 user nova-compute[74788]:   <os>
Nov 08 15:19:19 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:19:19 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:19:19 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:19:19 user nova-compute[74788]:   </os>
Nov 08 15:19:19 user nova-compute[74788]:   <features>
Nov 08 15:19:19 user nova-compute[74788]:     <acpi/>
Nov 08 15:19:19 user nova-compute[74788]:     <apic/>
Nov 08 15:19:19 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:19:19 user nova-compute[74788]:   </features>
Nov 08 15:19:19 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:19:19 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:19:19 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:19:19 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:19:19 user nova-compute[74788]:   </clock>
Nov 08 15:19:19 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:19:19 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:19:19 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:19:19 user nova-compute[74788]:   </cpu>
Nov 08 15:19:19 user nova-compute[74788]:   <devices>
Nov 08 15:19:19 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:19:19 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:19:19 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk"/>
Nov 08 15:19:19 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:19:19 user nova-compute[74788]:     </disk>
Nov 08 15:19:19 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:19:19 user nova-compute[74788]:       <mac address="fa:16:3e:dc:95:ea"/>
Nov 08 15:19:19 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:19 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:19:19 user nova-compute[74788]:       <target dev="tap384c3842-8f"/>
Nov 08 15:19:19 user nova-compute[74788]:     </interface>
Nov 08 15:19:19 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:19:19 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/console.log" append="off"/>
Nov 08 15:19:19 user nova-compute[74788]:     </serial>
Nov 08 15:19:19 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:19:19 user nova-compute[74788]:     <video>
Nov 08 15:19:19 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:19 user nova-compute[74788]:     </video>
Nov 08 15:19:19 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:19:19 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:19:19 user nova-compute[74788]:     </rng>
Nov 08 15:19:19 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:19:19 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:19:19 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:19:19 user nova-compute[74788]:     </memballoon>
Nov 08 15:19:19 user nova-compute[74788]:   </devices>
Nov 08 15:19:19 user nova-compute[74788]: </domain>
Nov 08 15:19:19 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-808333465',display_name='tempest-ServerActionsTestOtherA-server-808333465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-808333465',id=15,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-ah2d0bp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=e0c3ad12-7047-4836-9f7b-c80a95aeeac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_vif [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[83106119-ba21-4a74-95e0-5aad9921855e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c910bdc2-1c48-5d02-a763-8ad053f5aa8a', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap384c3842-8f, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap384c3842-8f, col_values=(('qos', UUID('c8f8725c-0d49-4a05-a066-a70e7ee74054')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap384c3842-8f, col_values=(('external_ids', {'iface-id': '384c3842-8fb5-435d-8451-91efba79f9b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:95:ea', 'vm-uuid': 'e0c3ad12-7047-4836-9f7b-c80a95aeeac6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:19 user nova-compute[74788]: INFO os_vif [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f')
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[70130bd3-59df-4436-9278-4d224e6ad200]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260]
Nov 08 15:19:19 user nova-compute[74788]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92, portal: 172.16.0.220,3260] successful.
Nov 08 15:19:19 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc8d7ace-0c3b-447b-94dc-60cbcceceb92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2c2d31-7bde-4c73-a98d-268f5ec12b6b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] <== disconnect_volume: return (370ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:dc:95:ea, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing instance network info cache due to event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:19 user nova-compute[74788]: DEBUG nova.network.neutron [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'flavor' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1c41c90-e14b-46c6-a7f0-25e8c308add5 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.network.neutron [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated VIF entry in instance network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.network.neutron [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2fb06e9a-1d19-4056-9b37-307d874ef560 req-06e48c0b-4d33-4a16-af08-8f4f1eed1804 service nova] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:19:20 user nova-compute[74788]: INFO nova.compute.claims [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Claim successful on node user
Nov 08 15:19:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] No waiting events found dispatching network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:20 user nova-compute[74788]: WARNING nova.compute.manager [req-ec696f5d-dea5-4409-bc46-3009b175d64f req-f05ea675-6a30-4195-8fa8-20235706798c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received unexpected event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 for instance with vm_state building and task_state spawning.
Nov 08 15:19:20 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:19:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.policy [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '819d9ebc3f50429ba373b0e9a024e8e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7b335769914fa3b8937f2ec7d0838e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:19:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Creating image(s)
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "/opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "/opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "/opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk 1073741824" returned: 0 in 0.056s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Successfully created port: 6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Cannot resize image /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Ensure instance console log exists: /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Successfully updated port: 6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquired lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-changed-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Refreshing instance network info cache due to event network-changed-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] Acquiring lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Updating instance_info_cache with network_info: [{"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Releasing lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Instance network_info: |[{"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] Acquired lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Refreshing network info cache for port 6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Start _get_guest_xml network_info=[{"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:19:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2073173589',display_name='tempest-DeleteServersTestJSON-server-2073173589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2073173589',id=16,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7b335769914fa3b8937f2ec7d0838e',ramdisk_id='',reservation_id='r-hniws75o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1202393964',owner_user_name='tempest-DeleteServersTestJSON-1202393964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:21Z,user_data=None,user_id='819d9ebc3f50429ba373b0e9a024e8e5',uuid=69dab681-c97f-4e62-8fbd-80af3ff55df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converting VIF {"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lazy-loading 'pci_devices' on Instance uuid 69dab681-c97f-4e62-8fbd-80af3ff55df0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:19:22 user nova-compute[74788]:   <uuid>69dab681-c97f-4e62-8fbd-80af3ff55df0</uuid>
Nov 08 15:19:22 user nova-compute[74788]:   <name>instance-00000010</name>
Nov 08 15:19:22 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:19:22 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:19:22 user nova-compute[74788]:   <metadata>
Nov 08 15:19:22 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:19:22 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:name>tempest-DeleteServersTestJSON-server-2073173589</nova:name>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:19:22</nova:creationTime>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:19:22 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:19:22 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:owner>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:user uuid="819d9ebc3f50429ba373b0e9a024e8e5">tempest-DeleteServersTestJSON-1202393964-project-member</nova:user>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:project uuid="2f7b335769914fa3b8937f2ec7d0838e">tempest-DeleteServersTestJSON-1202393964</nova:project>
Nov 08 15:19:22 user nova-compute[74788]:       </nova:owner>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:19:22 user nova-compute[74788]:       <nova:ports>
Nov 08 15:19:22 user nova-compute[74788]:         <nova:port uuid="6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0">
Nov 08 15:19:22 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:19:22 user nova-compute[74788]:         </nova:port>
Nov 08 15:19:22 user nova-compute[74788]:       </nova:ports>
Nov 08 15:19:22 user nova-compute[74788]:     </nova:instance>
Nov 08 15:19:22 user nova-compute[74788]:   </metadata>
Nov 08 15:19:22 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:19:22 user nova-compute[74788]:     <system>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="serial">69dab681-c97f-4e62-8fbd-80af3ff55df0</entry>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="uuid">69dab681-c97f-4e62-8fbd-80af3ff55df0</entry>
Nov 08 15:19:22 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:19:22 user nova-compute[74788]:     </system>
Nov 08 15:19:22 user nova-compute[74788]:   </sysinfo>
Nov 08 15:19:22 user nova-compute[74788]:   <os>
Nov 08 15:19:22 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:19:22 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:19:22 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:19:22 user nova-compute[74788]:   </os>
Nov 08 15:19:22 user nova-compute[74788]:   <features>
Nov 08 15:19:22 user nova-compute[74788]:     <acpi/>
Nov 08 15:19:22 user nova-compute[74788]:     <apic/>
Nov 08 15:19:22 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:19:22 user nova-compute[74788]:   </features>
Nov 08 15:19:22 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:19:22 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:19:22 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:19:22 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:19:22 user nova-compute[74788]:   </clock>
Nov 08 15:19:22 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:19:22 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:19:22 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:19:22 user nova-compute[74788]:   </cpu>
Nov 08 15:19:22 user nova-compute[74788]:   <devices>
Nov 08 15:19:22 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:19:22 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:19:22 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk"/>
Nov 08 15:19:22 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:19:22 user nova-compute[74788]:     </disk>
Nov 08 15:19:22 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:19:22 user nova-compute[74788]:       <mac address="fa:16:3e:b4:eb:e8"/>
Nov 08 15:19:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:22 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:19:22 user nova-compute[74788]:       <target dev="tap6a9bbaa2-7a"/>
Nov 08 15:19:22 user nova-compute[74788]:     </interface>
Nov 08 15:19:22 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:19:22 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/console.log" append="off"/>
Nov 08 15:19:22 user nova-compute[74788]:     </serial>
Nov 08 15:19:22 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:19:22 user nova-compute[74788]:     <video>
Nov 08 15:19:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:22 user nova-compute[74788]:     </video>
Nov 08 15:19:22 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:19:22 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:19:22 user nova-compute[74788]:     </rng>
Nov 08 15:19:22 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:19:22 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:19:22 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:19:22 user nova-compute[74788]:     </memballoon>
Nov 08 15:19:22 user nova-compute[74788]:   </devices>
Nov 08 15:19:22 user nova-compute[74788]: </domain>
Nov 08 15:19:22 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2073173589',display_name='tempest-DeleteServersTestJSON-server-2073173589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2073173589',id=16,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7b335769914fa3b8937f2ec7d0838e',ramdisk_id='',reservation_id='r-hniws75o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1202393964',owner_user_name='tempest-DeleteServersTestJSON-1202393964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:21Z,user_data=None,user_id='819d9ebc3f50429ba373b0e9a024e8e5',uuid=69dab681-c97f-4e62-8fbd-80af3ff55df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converting VIF {"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG os_vif [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91374ba0-74d2-597f-a5cb-37a17af4339f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9bbaa2-7a, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9bbaa2-7a, col_values=(('qos', UUID('12290302-409f-406a-9af0-bec070d998d3')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9bbaa2-7a, col_values=(('external_ids', {'iface-id': '6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:eb:e8', 'vm-uuid': '69dab681-c97f-4e62-8fbd-80af3ff55df0'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:22 user nova-compute[74788]: INFO os_vif [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a')
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] No VIF found with MAC fa:16:3e:b4:eb:e8, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:19:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Instance spawned successfully.
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] No waiting events found dispatching network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:22 user nova-compute[74788]: WARNING nova.compute.manager [req-6d0d5e70-b35a-464e-bd76-cc45e2794053 req-0cfc48ae-b2ba-4ff5-924c-dc39a5cb6271 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received unexpected event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 for instance with vm_state building and task_state spawning.
Nov 08 15:19:23 user nova-compute[74788]: INFO nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Took 9.38 seconds to spawn the instance on the hypervisor.
Nov 08 15:19:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:19:23 user nova-compute[74788]: INFO nova.compute.manager [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Took 10.29 seconds to build instance.
Nov 08 15:19:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0642e2d-a703-4de4-ba79-3806e22a0258 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.417s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Updated VIF entry in instance network info cache for port 6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:19:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Updating instance_info_cache with network_info: [{"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-52e317b0-81d9-4b77-9b5e-7a91c7c5aa98 req-6e45689a-985e-46ce-b2fc-79f000990093 service nova] Releasing lock "refresh_cache-69dab681-c97f-4e62-8fbd-80af3ff55df0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] No waiting events found dispatching network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:25 user nova-compute[74788]: WARNING nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received unexpected event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 for instance with vm_state building and task_state spawning.
Nov 08 15:19:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] No waiting events found dispatching network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:25 user nova-compute[74788]: WARNING nova.compute.manager [req-59c6f8b5-229d-439a-ae59-37a8427f2d76 req-d6118001-6dfb-4a82-8907-3494eb0b95aa service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received unexpected event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 for instance with vm_state building and task_state spawning.
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:19:26 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Instance spawned successfully.
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:26 user nova-compute[74788]: INFO nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 08 15:19:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:19:26 user nova-compute[74788]: INFO nova.compute.manager [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Took 6.58 seconds to build instance.
Nov 08 15:19:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1fc0773-8096-44dc-81a7-f65adbb3cea9 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.679s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:19:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [{"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-4d4cedbd-4e31-4aad-a580-da6aded0134f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:19:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'flavor' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:35 user nova-compute[74788]: INFO nova.compute.manager [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Attaching volume 217040bd-423d-46a4-a6d8-c7e2a762afcf to /dev/vdb
Nov 08 15:19:35 user nova-compute[74788]: DEBUG os_brick.utils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ed0607-6e5f-4275-bf70-e306039e98e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77f005-65ee-4719-8cb1-4e28e2d19edb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc251bba-bd7f-4177-9ea5-73bc77a9d055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb360a74-4721-4ec1-9e3c-eba15303372e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:19:36 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff37125-0988-4f01-adab-1773a6dc2f8f]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG os_brick.utils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating existing volume attachment record: 0d8bc316-19ef-4a53-a4ff-dd63bb1c700e {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:36 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:40 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:40 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.59021759033203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 966892ee-94c8-442e-911d-54941e0efdbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 9357621e-cd81-491a-87ac-803f576688c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance bf5695e6-02aa-4093-a556-a62e367b5925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69dab681-c97f-4e62-8fbd-80af3ff55df0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:19:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:19:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:45 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:19:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:19:47 user nova-compute[74788]: INFO nova.compute.claims [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Claim successful on node user
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:19:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.policy [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6455bc0197734cce88c64797bd83fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fac0333dca24d81b8127258c41a3145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:19:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Creating image(s)
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.246s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk 1073741824" returned: 0 in 0.062s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Successfully created port: fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:48 user nova-compute[74788]: INFO nova.compute.manager [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Terminating instance
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Cannot resize image /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Ensure instance console log exists: /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Instance destroyed successfully.
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lazy-loading 'resources' on Instance uuid 9357621e-cd81-491a-87ac-803f576688c2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2047802173',display_name='tempest-TestServerVolumeAttachmentScenario-server-2047802173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2047802173',id=11,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRiGl2qPq/c7/dl0fgjKimCRY36makp0AYNTQsK1kjg0AucqOhDqD8mtrg5m70TLBStymstIZdPtC37xc/EUaMpw0f20zLPO4uLsCbyipqngY0rOo1f6ofK7SDV+8KJdg==',key_name='tempest-keypair-2000952990',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5ac793f47a8441b93944f5612fd5986',ramdisk_id='',reservation_id='r-ivf1xm6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-616314953',owner_user_name='tempest-TestServerVolumeAttachmentScenario-616314953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93fef888f2054e41b67520e217b9ae8f',uuid=9357621e-cd81-491a-87ac-803f576688c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converting VIF {"id": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "address": "fa:16:3e:02:b2:66", "network": {"id": "ddc01349-d510-4ec9-912c-01c642ff3f55", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-636973067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5ac793f47a8441b93944f5612fd5986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee41a64-a4", "ovs_interfaceid": "dee41a64-a441-4641-9d43-8a1fb62ed5d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG os_vif [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdee41a64-a4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5d282c5-31f6-41b3-8167-1f2b99580433) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-unplugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] No waiting events found dispatching network-vif-unplugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-ca787f08-f96c-426c-9f5a-2e57a9399197 req-66769697-c3e4-45dd-b656-91ac210646d3 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-unplugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:19:49 user nova-compute[74788]: INFO os_vif [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b2:66,bridge_name='br-int',has_traffic_filtering=True,id=dee41a64-a441-4641-9d43-8a1fb62ed5d0,network=Network(ddc01349-d510-4ec9-912c-01c642ff3f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee41a64-a4')
Nov 08 15:19:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Deleting instance files /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2_del
Nov 08 15:19:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Deletion of /opt/stack/data/nova/instances/9357621e-cd81-491a-87ac-803f576688c2_del complete
Nov 08 15:19:49 user nova-compute[74788]: INFO nova.compute.manager [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Successfully updated port: fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance network_info: |[{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start _get_guest_xml network_info=[{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:19:50 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:50 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwypp1+8dqzzWKrglx0S05tZL9dCcJrjeCyAUldZ8pXOhaThF/DqUrfT7pCM2CPJX2YwUx7FPEawhmk1uoIQR9v6zmQPEBG82ScolKxKeHtXkYk1J/bCxKdHUTVfRcgnw==',key_name='tempest-keypair-1161035840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_devices' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:19:50 user nova-compute[74788]:   <uuid>751fb539-5e41-405a-af55-40a54d1ce66d</uuid>
Nov 08 15:19:50 user nova-compute[74788]:   <name>instance-00000011</name>
Nov 08 15:19:50 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:19:50 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:19:50 user nova-compute[74788]:   <metadata>
Nov 08 15:19:50 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:19:50 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-56075347</nova:name>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:19:50</nova:creationTime>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:19:50 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:19:50 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:owner>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:user uuid="6455bc0197734cce88c64797bd83fc2b">tempest-AttachVolumeShelveTestJSON-300191316-project-member</nova:user>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:project uuid="6fac0333dca24d81b8127258c41a3145">tempest-AttachVolumeShelveTestJSON-300191316</nova:project>
Nov 08 15:19:50 user nova-compute[74788]:       </nova:owner>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:19:50 user nova-compute[74788]:       <nova:ports>
Nov 08 15:19:50 user nova-compute[74788]:         <nova:port uuid="fe1e7383-efd7-4e26-820a-28556fe554c1">
Nov 08 15:19:50 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:19:50 user nova-compute[74788]:         </nova:port>
Nov 08 15:19:50 user nova-compute[74788]:       </nova:ports>
Nov 08 15:19:50 user nova-compute[74788]:     </nova:instance>
Nov 08 15:19:50 user nova-compute[74788]:   </metadata>
Nov 08 15:19:50 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:19:50 user nova-compute[74788]:     <system>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="serial">751fb539-5e41-405a-af55-40a54d1ce66d</entry>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="uuid">751fb539-5e41-405a-af55-40a54d1ce66d</entry>
Nov 08 15:19:50 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:19:50 user nova-compute[74788]:     </system>
Nov 08 15:19:50 user nova-compute[74788]:   </sysinfo>
Nov 08 15:19:50 user nova-compute[74788]:   <os>
Nov 08 15:19:50 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:19:50 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:19:50 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:19:50 user nova-compute[74788]:   </os>
Nov 08 15:19:50 user nova-compute[74788]:   <features>
Nov 08 15:19:50 user nova-compute[74788]:     <acpi/>
Nov 08 15:19:50 user nova-compute[74788]:     <apic/>
Nov 08 15:19:50 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:19:50 user nova-compute[74788]:   </features>
Nov 08 15:19:50 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:19:50 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:19:50 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:19:50 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:19:50 user nova-compute[74788]:   </clock>
Nov 08 15:19:50 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:19:50 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:19:50 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:19:50 user nova-compute[74788]:   </cpu>
Nov 08 15:19:50 user nova-compute[74788]:   <devices>
Nov 08 15:19:50 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:19:50 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:19:50 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk"/>
Nov 08 15:19:50 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:19:50 user nova-compute[74788]:     </disk>
Nov 08 15:19:50 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:19:50 user nova-compute[74788]:       <mac address="fa:16:3e:34:2d:ca"/>
Nov 08 15:19:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:50 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:19:50 user nova-compute[74788]:       <target dev="tapfe1e7383-ef"/>
Nov 08 15:19:50 user nova-compute[74788]:     </interface>
Nov 08 15:19:50 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:19:50 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/console.log" append="off"/>
Nov 08 15:19:50 user nova-compute[74788]:     </serial>
Nov 08 15:19:50 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:19:50 user nova-compute[74788]:     <video>
Nov 08 15:19:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:19:50 user nova-compute[74788]:     </video>
Nov 08 15:19:50 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:19:50 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:19:50 user nova-compute[74788]:     </rng>
Nov 08 15:19:50 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:19:50 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:19:50 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:19:50 user nova-compute[74788]:     </memballoon>
Nov 08 15:19:50 user nova-compute[74788]:   </devices>
Nov 08 15:19:50 user nova-compute[74788]: </domain>
Nov 08 15:19:50 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwypp1+8dqzzWKrglx0S05tZL9dCcJrjeCyAUldZ8pXOhaThF/DqUrfT7pCM2CPJX2YwUx7FPEawhmk1uoIQR9v6zmQPEBG82ScolKxKeHtXkYk1J/bCxKdHUTVfRcgnw==',key_name='tempest-keypair-1161035840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG os_vif [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdb41e9a-be35-5d42-9166-d88333c43433', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1e7383-ef, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe1e7383-ef, col_values=(('qos', UUID('f3f51835-146c-44ed-a490-f457cf00b3b7')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe1e7383-ef, col_values=(('external_ids', {'iface-id': 'fe1e7383-efd7-4e26-820a-28556fe554c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:2d:ca', 'vm-uuid': '751fb539-5e41-405a-af55-40a54d1ce66d'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:50 user nova-compute[74788]: INFO os_vif [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef')
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:19:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No VIF found with MAC fa:16:3e:34:2d:ca, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:51 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Took 1.39 seconds to deallocate network for instance.
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c81e2d3-a533-4804-8453-69f65b405a65 req-29dd651e-edc4-4a45-8cca-9f0fd95a1b7a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-deleted-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:51 user nova-compute[74788]: INFO nova.compute.manager [req-3c81e2d3-a533-4804-8453-69f65b405a65 req-29dd651e-edc4-4a45-8cca-9f0fd95a1b7a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Neutron deleted interface dee41a64-a441-4641-9d43-8a1fb62ed5d0; detaching it from the instance and deleting it from the info cache
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-3c81e2d3-a533-4804-8453-69f65b405a65 req-29dd651e-edc4-4a45-8cca-9f0fd95a1b7a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c81e2d3-a533-4804-8453-69f65b405a65 req-29dd651e-edc4-4a45-8cca-9f0fd95a1b7a service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Detach interface failed, port_id=dee41a64-a441-4641-9d43-8a1fb62ed5d0, reason: Instance 9357621e-cd81-491a-87ac-803f576688c2 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:51 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Deleted allocations for instance 9357621e-cd81-491a-87ac-803f576688c2
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing instance network info cache due to event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:19:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1b0bba2b-41c5-475d-8c34-129534ebd9a2 tempest-TestServerVolumeAttachmentScenario-616314953 tempest-TestServerVolumeAttachmentScenario-616314953-project-member] Lock "9357621e-cd81-491a-87ac-803f576688c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.037s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updated VIF entry in instance network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Acquiring lock "9357621e-cd81-491a-87ac-803f576688c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] Lock "9357621e-cd81-491a-87ac-803f576688c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] No waiting events found dispatching network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:52 user nova-compute[74788]: WARNING nova.compute.manager [req-fc6bedf6-7258-469c-946e-3b652ab1210e req-096fc8a1-3e8c-4b90-9e4a-84f08ec1f699 service nova] [instance: 9357621e-cd81-491a-87ac-803f576688c2] Received unexpected event network-vif-plugged-dee41a64-a441-4641-9d43-8a1fb62ed5d0 for instance with vm_state deleted and task_state None.
Nov 08 15:19:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:52 user nova-compute[74788]: WARNING nova.compute.manager [req-55454f0f-4ea4-4be6-98a2-975eee606194 req-a5ae59fc-6858-4bd9-b18a-82b8a6b3cbf2 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state building and task_state spawning.
Nov 08 15:19:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:19:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance spawned successfully.
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:54 user nova-compute[74788]: WARNING nova.compute.manager [req-abebbeeb-3f4e-45fb-906d-d1977663e1a7 req-fe1352b9-72fd-4fb7-ad25-097e5e71a038 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state building and task_state spawning.
Nov 08 15:19:54 user nova-compute[74788]: INFO nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 08 15:19:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:19:54 user nova-compute[74788]: INFO nova.compute.manager [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Took 7.87 seconds to build instance.
Nov 08 15:19:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8246d158-4969-4fe9-8846-599198015c9e tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.991s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:57 user nova-compute[74788]: INFO nova.compute.manager [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Terminating instance
Nov 08 15:19:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-unplugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] No waiting events found dispatching network-vif-unplugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-db063619-4478-45f4-9593-75d5253d0950 req-126eed35-b1e5-4a03-b89d-6c77a9bd57c7 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-unplugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Instance destroyed successfully.
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.objects.instance [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lazy-loading 'resources' on Instance uuid 966892ee-94c8-442e-911d-54941e0efdbd {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1666466500',display_name='tempest-VolumesAdminNegativeTest-server-1666466500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1666466500',id=3,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj6JO4tWGQMc+z8RsXRxxJC8QpdFq1GoR1D+M+p7pkL6nv3eLx+EcpVviIjAGt96kdw5/9bSJ9eLSYyMC++gvWMYLQga6QwuSjrT70DhbkRbkBLNImBr37GQlRFt93Eng==',key_name='tempest-keypair-851874093',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:12:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9989f0594d764f1b95aa6ee59d9b65ea',ramdisk_id='',reservation_id='r-ucxmyf10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-571382466',owner_user_name='tempest-VolumesAdminNegativeTest-571382466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946d9aeee5664b8c8f2c2e09604df6da',uuid=966892ee-94c8-442e-911d-54941e0efdbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converting VIF {"id": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "address": "fa:16:3e:f3:c6:cf", "network": {"id": "b20ae31a-d71c-47aa-ba5d-87a406749924", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-33505159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9989f0594d764f1b95aa6ee59d9b65ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b82f6a-a3", "ovs_interfaceid": "95b82f6a-a3fb-471e-9806-04a5dd098e47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG os_vif [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95b82f6a-a3, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f52e5b48-4b19-46df-b45b-0bdfebaa68a1) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:19:58 user nova-compute[74788]: INFO os_vif [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:c6:cf,bridge_name='br-int',has_traffic_filtering=True,id=95b82f6a-a3fb-471e-9806-04a5dd098e47,network=Network(b20ae31a-d71c-47aa-ba5d-87a406749924),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b82f6a-a3')
Nov 08 15:19:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Deleting instance files /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd_del
Nov 08 15:19:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Deletion of /opt/stack/data/nova/instances/966892ee-94c8-442e-911d-54941e0efdbd_del complete
Nov 08 15:19:58 user nova-compute[74788]: INFO nova.compute.manager [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 15:19:58 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:19:58 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:19:59 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:19:59 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Took 0.80 seconds to deallocate network for instance.
Nov 08 15:19:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-40540f34-7452-4d25-858a-d4ce099722b1 req-b18d7d19-ba45-4761-bc6e-04ba50079be1 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-deleted-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:19:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:19:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:00 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Deleted allocations for instance 966892ee-94c8-442e-911d-54941e0efdbd
Nov 08 15:20:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-beae82df-1548-4784-9cbe-80c7cf8625ac tempest-VolumesAdminNegativeTest-571382466 tempest-VolumesAdminNegativeTest-571382466-project-member] Lock "966892ee-94c8-442e-911d-54941e0efdbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] Acquiring lock "966892ee-94c8-442e-911d-54941e0efdbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] Lock "966892ee-94c8-442e-911d-54941e0efdbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] No waiting events found dispatching network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:00 user nova-compute[74788]: WARNING nova.compute.manager [req-90ee1e89-7bec-409f-9372-dd96deff3a42 req-abf4cd47-4db2-40a6-a568-45d3505118b6 service nova] [instance: 966892ee-94c8-442e-911d-54941e0efdbd] Received unexpected event network-vif-plugged-95b82f6a-a3fb-471e-9806-04a5dd098e47 for instance with vm_state deleted and task_state None.
Nov 08 15:20:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:20:01 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:01 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:01 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64aa8f-2c9b-4741-900b-c7d8b63fe65b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:20:01 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0a857-a4d5-4a3c-9fe3-e5c6afac985c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf] added
Nov 08 15:20:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4229039-52db-4bcc-bfd6-452cda4294cd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3d426-661e-49aa-ae60-e532afc27691]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmTZHrXP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmTZHrXP" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f9712-2baa-452f-9400-31b1b97b99a5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmTZHrXP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a907be-a03b-48de-b7fa-093e3b64c25f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad34086-6c0c-423e-a3ea-fd7e21cbb50a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a7db9-1078-4d43-b224-a4b3548019fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]
Nov 08 15:20:02 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.
Nov 08 15:20:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45393c1b-b0ea-4115-b25e-e839d17d1fb0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b34569-cfed-4e3d-87bf-c68db926781a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:02 user nova-compute[74788]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:02 user nova-compute[74788]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[161310ed-df55-4b08-bc99-affa594a7060]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:20:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26233326336656465', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233326336656465', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'flavor' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:20:03 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:20:03 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:20:03 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:20:03 user nova-compute[74788]:   <serial>217040bd-423d-46a4-a6d8-c7e2a762afcf</serial>
Nov 08 15:20:03 user nova-compute[74788]: </disk>
Nov 08 15:20:03 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No VIF found with MAC fa:16:3e:17:6f:8c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a77b943d-ceab-44d0-9c1e-4b9cb1d8fdaa tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.957s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:12 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:20:12 user nova-compute[74788]: INFO nova.compute.claims [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Claim successful on node user
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:20:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.policy [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9364a17762748f3a27b326ad597b5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cd17a9a5cd463ea901bc494dec7a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:20:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Creating image(s)
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "/opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "/opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "/opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk 1073741824" returned: 0 in 0.049s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Successfully created port: cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Cannot resize image /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Ensure instance console log exists: /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Successfully updated port: cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquired lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-changed-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Refreshing instance network info cache due to event network-changed-cdb4d366-80fe-492d-8088-cb9c35ee39f5. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] Acquiring lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Updating instance_info_cache with network_info: [{"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Releasing lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Instance network_info: |[{"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] Acquired lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Refreshing network info cache for port cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Start _get_guest_xml network_info=[{"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:20:15 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:15 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530679016',display_name='tempest-ServersNegativeTestJSON-server-1530679016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530679016',id=18,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-olkopwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:13Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lazy-loading 'pci_devices' on Instance uuid d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:20:15 user nova-compute[74788]:   <uuid>d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845</uuid>
Nov 08 15:20:15 user nova-compute[74788]:   <name>instance-00000012</name>
Nov 08 15:20:15 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:20:15 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:20:15 user nova-compute[74788]:   <metadata>
Nov 08 15:20:15 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:20:15 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:name>tempest-ServersNegativeTestJSON-server-1530679016</nova:name>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:20:15</nova:creationTime>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:20:15 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:20:15 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:owner>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:user uuid="d9364a17762748f3a27b326ad597b5c0">tempest-ServersNegativeTestJSON-1624352802-project-member</nova:user>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:project uuid="e3cd17a9a5cd463ea901bc494dec7a78">tempest-ServersNegativeTestJSON-1624352802</nova:project>
Nov 08 15:20:15 user nova-compute[74788]:       </nova:owner>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:20:15 user nova-compute[74788]:       <nova:ports>
Nov 08 15:20:15 user nova-compute[74788]:         <nova:port uuid="cdb4d366-80fe-492d-8088-cb9c35ee39f5">
Nov 08 15:20:15 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 15:20:15 user nova-compute[74788]:         </nova:port>
Nov 08 15:20:15 user nova-compute[74788]:       </nova:ports>
Nov 08 15:20:15 user nova-compute[74788]:     </nova:instance>
Nov 08 15:20:15 user nova-compute[74788]:   </metadata>
Nov 08 15:20:15 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:20:15 user nova-compute[74788]:     <system>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="serial">d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845</entry>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="uuid">d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845</entry>
Nov 08 15:20:15 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:20:15 user nova-compute[74788]:     </system>
Nov 08 15:20:15 user nova-compute[74788]:   </sysinfo>
Nov 08 15:20:15 user nova-compute[74788]:   <os>
Nov 08 15:20:15 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:20:15 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:20:15 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:20:15 user nova-compute[74788]:   </os>
Nov 08 15:20:15 user nova-compute[74788]:   <features>
Nov 08 15:20:15 user nova-compute[74788]:     <acpi/>
Nov 08 15:20:15 user nova-compute[74788]:     <apic/>
Nov 08 15:20:15 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:20:15 user nova-compute[74788]:   </features>
Nov 08 15:20:15 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:20:15 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:20:15 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:20:15 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:20:15 user nova-compute[74788]:   </clock>
Nov 08 15:20:15 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:20:15 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:20:15 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:20:15 user nova-compute[74788]:   </cpu>
Nov 08 15:20:15 user nova-compute[74788]:   <devices>
Nov 08 15:20:15 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:20:15 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:20:15 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk"/>
Nov 08 15:20:15 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:20:15 user nova-compute[74788]:     </disk>
Nov 08 15:20:15 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:20:15 user nova-compute[74788]:       <mac address="fa:16:3e:4a:9c:3d"/>
Nov 08 15:20:15 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:15 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:20:15 user nova-compute[74788]:       <target dev="tapcdb4d366-80"/>
Nov 08 15:20:15 user nova-compute[74788]:     </interface>
Nov 08 15:20:15 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:20:15 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/console.log" append="off"/>
Nov 08 15:20:15 user nova-compute[74788]:     </serial>
Nov 08 15:20:15 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:20:15 user nova-compute[74788]:     <video>
Nov 08 15:20:15 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:15 user nova-compute[74788]:     </video>
Nov 08 15:20:15 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:20:15 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:20:15 user nova-compute[74788]:     </rng>
Nov 08 15:20:15 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:20:15 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:20:15 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:20:15 user nova-compute[74788]:     </memballoon>
Nov 08 15:20:15 user nova-compute[74788]:   </devices>
Nov 08 15:20:15 user nova-compute[74788]: </domain>
Nov 08 15:20:15 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530679016',display_name='tempest-ServersNegativeTestJSON-server-1530679016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530679016',id=18,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-olkopwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:13Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG os_vif [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1eb8e2e1-111e-5d5d-b67d-6d7af87e10a8', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdb4d366-80, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdb4d366-80, col_values=(('qos', UUID('5439eae3-fe98-4fb6-8317-1174f960122b')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdb4d366-80, col_values=(('external_ids', {'iface-id': 'cdb4d366-80fe-492d-8088-cb9c35ee39f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:9c:3d', 'vm-uuid': 'd62aaa8a-1b07-4eb0-88a3-6bc98ad1a845'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:15 user nova-compute[74788]: INFO os_vif [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80')
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] No VIF found with MAC fa:16:3e:4a:9c:3d, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Updated VIF entry in instance network info cache for port cdb4d366-80fe-492d-8088-cb9c35ee39f5. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Updating instance_info_cache with network_info: [{"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ab61605-fd3d-4962-915f-554d675cd477 req-24180e11-d281-4b6c-a1c3-2a153d534e30 service nova] Releasing lock "refresh_cache-d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] No waiting events found dispatching network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:17 user nova-compute[74788]: WARNING nova.compute.manager [req-075d37f7-71db-4a7f-a0fe-0c5d7c484c4a req-faba3974-555c-4be7-84e5-8b3e4f36d08d service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received unexpected event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 for instance with vm_state building and task_state spawning.
Nov 08 15:20:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:20:18 user nova-compute[74788]: INFO nova.compute.claims [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Claim successful on node user
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:20:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.policy [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfd067f5d7d64fd38a5599a0cf4db51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c4a8437a8a4c54bef06408109fca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:20:18 user nova-compute[74788]: INFO nova.compute.claims [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Claim successful on node user
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:20:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Creating image(s)
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.247s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing instance network info cache due to event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.network.neutron [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk 1073741824" returned: 0 in 0.079s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] No waiting events found dispatching network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:19 user nova-compute[74788]: WARNING nova.compute.manager [req-dd81b387-53ad-477c-9ec7-7444d1d6c8e7 req-66d656c0-6b6e-4164-8166-805075b81f7a service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received unexpected event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 for instance with vm_state building and task_state spawning.
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:20:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Instance spawned successfully.
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:20:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:20:19 user nova-compute[74788]: INFO nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Successfully created port: 2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.policy [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfd067f5d7d64fd38a5599a0cf4db51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c4a8437a8a4c54bef06408109fca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:20:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Creating image(s)
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:19 user nova-compute[74788]: INFO nova.compute.manager [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Took 7.32 seconds to build instance.
Nov 08 15:20:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2f012b37-9464-4106-a8c5-229517611995 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Cannot resize image /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Ensure instance console log exists: /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.network.neutron [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated VIF entry in instance network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.network.neutron [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fdca54bf-f618-4cea-81d3-64f1d503a977 req-ca3fbd48-1fb9-403d-b74d-370e97bb2188 service nova] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.263s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.222s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk 1073741824" returned: 0 in 0.071s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.245s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Successfully updated port: 2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:20:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Successfully created port: eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Cannot resize image /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance network_info: |[{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start _get_guest_xml network_info=[{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:20:21 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:21 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-900878772',display_name='tempest-ServerRescueNegativeTestJSON-server-900878772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-900878772',id=19,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-gtlcuzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:19Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=f4281708-3fc8-480c-9031-62fda80f8940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:20:21 user nova-compute[74788]:   <uuid>f4281708-3fc8-480c-9031-62fda80f8940</uuid>
Nov 08 15:20:21 user nova-compute[74788]:   <name>instance-00000013</name>
Nov 08 15:20:21 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:20:21 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:20:21 user nova-compute[74788]:   <metadata>
Nov 08 15:20:21 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:20:21 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-900878772</nova:name>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:20:21</nova:creationTime>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:20:21 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:20:21 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:owner>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:20:21 user nova-compute[74788]:       </nova:owner>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:20:21 user nova-compute[74788]:       <nova:ports>
Nov 08 15:20:21 user nova-compute[74788]:         <nova:port uuid="2222073c-88d5-40e6-8787-45da953d857a">
Nov 08 15:20:21 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 15:20:21 user nova-compute[74788]:         </nova:port>
Nov 08 15:20:21 user nova-compute[74788]:       </nova:ports>
Nov 08 15:20:21 user nova-compute[74788]:     </nova:instance>
Nov 08 15:20:21 user nova-compute[74788]:   </metadata>
Nov 08 15:20:21 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:20:21 user nova-compute[74788]:     <system>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="serial">f4281708-3fc8-480c-9031-62fda80f8940</entry>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="uuid">f4281708-3fc8-480c-9031-62fda80f8940</entry>
Nov 08 15:20:21 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:20:21 user nova-compute[74788]:     </system>
Nov 08 15:20:21 user nova-compute[74788]:   </sysinfo>
Nov 08 15:20:21 user nova-compute[74788]:   <os>
Nov 08 15:20:21 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:20:21 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:20:21 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:20:21 user nova-compute[74788]:   </os>
Nov 08 15:20:21 user nova-compute[74788]:   <features>
Nov 08 15:20:21 user nova-compute[74788]:     <acpi/>
Nov 08 15:20:21 user nova-compute[74788]:     <apic/>
Nov 08 15:20:21 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:20:21 user nova-compute[74788]:   </features>
Nov 08 15:20:21 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:20:21 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:20:21 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:20:21 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:20:21 user nova-compute[74788]:   </clock>
Nov 08 15:20:21 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:20:21 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:20:21 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:20:21 user nova-compute[74788]:   </cpu>
Nov 08 15:20:21 user nova-compute[74788]:   <devices>
Nov 08 15:20:21 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:20:21 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:20:21 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk"/>
Nov 08 15:20:21 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:20:21 user nova-compute[74788]:     </disk>
Nov 08 15:20:21 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:20:21 user nova-compute[74788]:       <mac address="fa:16:3e:e3:e4:f6"/>
Nov 08 15:20:21 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:21 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:20:21 user nova-compute[74788]:       <target dev="tap2222073c-88"/>
Nov 08 15:20:21 user nova-compute[74788]:     </interface>
Nov 08 15:20:21 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:20:21 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/console.log" append="off"/>
Nov 08 15:20:21 user nova-compute[74788]:     </serial>
Nov 08 15:20:21 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:20:21 user nova-compute[74788]:     <video>
Nov 08 15:20:21 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:21 user nova-compute[74788]:     </video>
Nov 08 15:20:21 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:20:21 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:20:21 user nova-compute[74788]:     </rng>
Nov 08 15:20:21 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:20:21 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:20:21 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:20:21 user nova-compute[74788]:     </memballoon>
Nov 08 15:20:21 user nova-compute[74788]:   </devices>
Nov 08 15:20:21 user nova-compute[74788]: </domain>
Nov 08 15:20:21 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-900878772',display_name='tempest-ServerRescueNegativeTestJSON-server-900878772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-900878772',id=19,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-gtlcuzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:19Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=f4281708-3fc8-480c-9031-62fda80f8940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG os_vif [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14873545-4cd4-550f-83c2-9e8452a31c52', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2222073c-88, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2222073c-88, col_values=(('qos', UUID('205bad04-d6fb-4050-82a4-189c8ffa14dc')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2222073c-88, col_values=(('external_ids', {'iface-id': '2222073c-88d5-40e6-8787-45da953d857a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e4:f6', 'vm-uuid': 'f4281708-3fc8-480c-9031-62fda80f8940'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:21 user nova-compute[74788]: INFO os_vif [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88')
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-changed-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Refreshing instance network info cache due to event network-changed-2222073c-88d5-40e6-8787-45da953d857a. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Refreshing network info cache for port 2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:e3:e4:f6, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Successfully updated port: eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-changed-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Refreshing instance network info cache due to event network-changed-eaae088b-d477-4248-a868-fe6d7545d647. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] Acquiring lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance network_info: |[{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] Acquired lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Refreshing network info cache for port eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start _get_guest_xml network_info=[{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:20:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020246904',display_name='tempest-ServerRescueNegativeTestJSON-server-2020246904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020246904',id=20,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-0m204bnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:20Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=6a9abf8f-0442-45c7-9d91-2a1c062437d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:20:22 user nova-compute[74788]:   <uuid>6a9abf8f-0442-45c7-9d91-2a1c062437d7</uuid>
Nov 08 15:20:22 user nova-compute[74788]:   <name>instance-00000014</name>
Nov 08 15:20:22 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:20:22 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:20:22 user nova-compute[74788]:   <metadata>
Nov 08 15:20:22 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:20:22 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020246904</nova:name>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:20:22</nova:creationTime>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:20:22 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:20:22 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:owner>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:20:22 user nova-compute[74788]:       </nova:owner>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:20:22 user nova-compute[74788]:       <nova:ports>
Nov 08 15:20:22 user nova-compute[74788]:         <nova:port uuid="eaae088b-d477-4248-a868-fe6d7545d647">
Nov 08 15:20:22 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 15:20:22 user nova-compute[74788]:         </nova:port>
Nov 08 15:20:22 user nova-compute[74788]:       </nova:ports>
Nov 08 15:20:22 user nova-compute[74788]:     </nova:instance>
Nov 08 15:20:22 user nova-compute[74788]:   </metadata>
Nov 08 15:20:22 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:20:22 user nova-compute[74788]:     <system>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="serial">6a9abf8f-0442-45c7-9d91-2a1c062437d7</entry>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="uuid">6a9abf8f-0442-45c7-9d91-2a1c062437d7</entry>
Nov 08 15:20:22 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:20:22 user nova-compute[74788]:     </system>
Nov 08 15:20:22 user nova-compute[74788]:   </sysinfo>
Nov 08 15:20:22 user nova-compute[74788]:   <os>
Nov 08 15:20:22 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:20:22 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:20:22 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:20:22 user nova-compute[74788]:   </os>
Nov 08 15:20:22 user nova-compute[74788]:   <features>
Nov 08 15:20:22 user nova-compute[74788]:     <acpi/>
Nov 08 15:20:22 user nova-compute[74788]:     <apic/>
Nov 08 15:20:22 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:20:22 user nova-compute[74788]:   </features>
Nov 08 15:20:22 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:20:22 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:20:22 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:20:22 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:20:22 user nova-compute[74788]:   </clock>
Nov 08 15:20:22 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:20:22 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:20:22 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:20:22 user nova-compute[74788]:   </cpu>
Nov 08 15:20:22 user nova-compute[74788]:   <devices>
Nov 08 15:20:22 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:20:22 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:20:22 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk"/>
Nov 08 15:20:22 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:20:22 user nova-compute[74788]:     </disk>
Nov 08 15:20:22 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:20:22 user nova-compute[74788]:       <mac address="fa:16:3e:f4:99:4e"/>
Nov 08 15:20:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:22 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:20:22 user nova-compute[74788]:       <target dev="tapeaae088b-d4"/>
Nov 08 15:20:22 user nova-compute[74788]:     </interface>
Nov 08 15:20:22 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:20:22 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/console.log" append="off"/>
Nov 08 15:20:22 user nova-compute[74788]:     </serial>
Nov 08 15:20:22 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:20:22 user nova-compute[74788]:     <video>
Nov 08 15:20:22 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:22 user nova-compute[74788]:     </video>
Nov 08 15:20:22 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:20:22 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:20:22 user nova-compute[74788]:     </rng>
Nov 08 15:20:22 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:20:22 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:20:22 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:20:22 user nova-compute[74788]:     </memballoon>
Nov 08 15:20:22 user nova-compute[74788]:   </devices>
Nov 08 15:20:22 user nova-compute[74788]: </domain>
Nov 08 15:20:22 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020246904',display_name='tempest-ServerRescueNegativeTestJSON-server-2020246904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020246904',id=20,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-0m204bnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:20Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=6a9abf8f-0442-45c7-9d91-2a1c062437d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG os_vif [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f34d5773-e04f-55f7-abf5-6486369b2f5f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaae088b-d4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaae088b-d4, col_values=(('qos', UUID('f8c3d875-7269-4b9a-93e3-e03ceb707fd9')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaae088b-d4, col_values=(('external_ids', {'iface-id': 'eaae088b-d477-4248-a868-fe6d7545d647', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:99:4e', 'vm-uuid': '6a9abf8f-0442-45c7-9d91-2a1c062437d7'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updated VIF entry in instance network info cache for port 2222073c-88d5-40e6-8787-45da953d857a. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: INFO os_vif [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4')
Nov 08 15:20:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cefb883b-82b7-4ca7-97c4-632d24352622 req-2b5161f7-55b0-4901-9944-4cffde387c0e service nova] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:f4:99:4e, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updated VIF entry in instance network info cache for port eaae088b-d477-4248-a868-fe6d7545d647. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-75b1d99e-78d8-4d01-b225-5222fea34fb4 req-b183190b-8b65-4def-b27b-198adc902f4a service nova] Releasing lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing instance network info cache due to event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated VIF entry in instance network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-da62b629-47af-4139-81cd-7640f99ae3e6 req-bd6f2435-2659-4921-931a-5732d9225d44 service nova] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:25 user nova-compute[74788]: WARNING nova.compute.manager [req-1065a439-df21-45e6-a4f2-a654a36b5e2a req-e4254145-d851-4c87-9fe2-bdd2e78029f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state building and task_state spawning.
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:25 user nova-compute[74788]: WARNING nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state building and task_state spawning.
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:25 user nova-compute[74788]: WARNING nova.compute.manager [req-66801a03-94f1-4757-869d-5fc36f795d5a req-2ba9a932-3ad5-4bb1-9efe-037d1c75715b service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state building and task_state spawning.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance spawned successfully.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:27 user nova-compute[74788]: WARNING nova.compute.manager [req-68e7560c-8b71-4239-808c-403c43ab04ed req-783a3a06-1428-4a4a-8c5c-58338f388bca service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state building and task_state spawning.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Took 8.50 seconds to spawn the instance on the hypervisor.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance spawned successfully.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Took 7.68 seconds to spawn the instance on the hypervisor.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.compute.manager [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Took 9.48 seconds to build instance.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7f09b771-6853-4545-abe2-50bb277c7dc0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.619s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:27 user nova-compute[74788]: INFO nova.compute.manager [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Took 8.92 seconds to build instance.
Nov 08 15:20:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0dde2aef-0892-4dfd-a6ba-66d0b987b1dd tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.048s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:20:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:36 user nova-compute[74788]: INFO nova.compute.manager [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Rebooting instance
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:38 user nova-compute[74788]: WARNING nova.compute.manager [req-40df6a6a-49dd-4a40-a585-7e7d002a721b req-3272c831-534f-48c2-9f28-46beefd44eb4 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state active and task_state reboot_started_hard.
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance destroyed successfully.
Nov 08 15:20:38 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'resources' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:20:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcf6e7bf-d4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9564a28-0d43-4d4a-9dfc-7ec042477754) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: INFO os_vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4')
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:20:39 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a09119f-7765-41f1-8394-59591f24e8c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:20:39 user nova-compute[74788]: No targets found.
Nov 08 15:20:39 user nova-compute[74788]: iSNS:
Nov 08 15:20:39 user nova-compute[74788]: No targets found.
Nov 08 15:20:39 user nova-compute[74788]: STATIC:
Nov 08 15:20:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf
Nov 08 15:20:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:20:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:20:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:20:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:20:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:20:39 user nova-compute[74788]: FIRMWARE:
Nov 08 15:20:39 user nova-compute[74788]: No targets found.
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:20:39 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:20:39 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[181dc7f5-78ed-4d9c-8195-4ca22950e168]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89828ec-602d-4ebe-bfb6-d984ccd1c118]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:39 user nova-compute[74788]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:39 user nova-compute[74788]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c216830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa390d-399d-4f1d-87b9-70e97bf9ea1f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae8e971-0959-4c91-9735-a0879d5d774b]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411cc2d-590d-46fb-855b-601658306858]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ce4846-820d-4a61-939e-0f29179ef416]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa1092-a160-4234-ab2a-435e659ac936]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd22d63e-b938-41b3-ad84-1429925f45ba]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]
Nov 08 15:20:39 user nova-compute[74788]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c17a7e-b804-44c6-ac23-1a543d503da8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== disconnect_volume: return (447ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start _get_guest_xml network_info=[{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01e1bbd8-d575-4619-9315-afa82edb0308,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '01e1bbd8-d575-4619-9315-afa82edb0308'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bf5695e6-02aa-4093-a556-a62e367b5925', 'attached_at': '', 'detached_at': '', 'volume_id': '217040bd-423d-46a4-a6d8-c7e2a762afcf', 'serial': '217040bd-423d-46a4-a6d8-c7e2a762afcf'}, 'attachment_id': '0d8bc316-19ef-4a53-a4ff-dd63bb1c700e', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:20:39 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:39 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01e1bbd8-d575-4619-9315-afa82edb0308,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.objects.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Object Instance<bf5695e6-02aa-4093-a556-a62e367b5925> lazy-loaded attributes: resources,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:20:39 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:39 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:39 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ae6cb6-daa0-422d-8a42-41392df83506]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:20:39 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b5635-9064-4507-bfe3-af569a5c05a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf] added
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[373d469b-9594-41ab-99e6-13cd639dff22]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473c28e-032d-4224-9f16-d04b123df1c1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmTZHrXP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmTZHrXP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2aad80-5d8b-4fce-aa9e-544c54dcef38]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmTZHrXP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f182b57c-c569-4bdc-859d-bec2adebbbb1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238bc6b-eb82-4de0-b11b-b69a8a60dcb1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3fc4c2-c9a3-4c37-b9bb-0feda477c2a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]
Nov 08 15:20:40 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.
Nov 08 15:20:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7565f705-0790-4cb6-aead-aaa59e645479]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1808b-0ec5-4667-a420-246f3910a5be]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:40 user nova-compute[74788]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:40 user nova-compute[74788]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7d190-5dfb-44a8-98a1-c227a2d75c4c]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:40 user nova-compute[74788]: WARNING nova.compute.manager [req-e7f2f52a-6107-4576-88c7-0277da532f4d req-f8b6487c-6248-4cc7-b2e5-bf2ac62b0587 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state active and task_state reboot_started_hard.
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26233326336656465', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233326336656465', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:20:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'pci_devices' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.objects.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Object Instance<bf5695e6-02aa-4093-a556-a62e367b5925> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:20:41 user nova-compute[74788]:   <uuid>bf5695e6-02aa-4093-a556-a62e367b5925</uuid>
Nov 08 15:20:41 user nova-compute[74788]:   <name>instance-0000000d</name>
Nov 08 15:20:41 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:20:41 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:20:41 user nova-compute[74788]:   <metadata>
Nov 08 15:20:41 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:20:41 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:name>tempest-TestMinimumBasicScenario-server-714106190</nova:name>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:20:39</nova:creationTime>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:20:41 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:20:41 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:owner>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:user uuid="4c06d28d62994d15b3a91c5d210eea4f">tempest-TestMinimumBasicScenario-181050692-project-member</nova:user>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:project uuid="a0f737b11a8d4a88b798295956c0c41f">tempest-TestMinimumBasicScenario-181050692</nova:project>
Nov 08 15:20:41 user nova-compute[74788]:       </nova:owner>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:root type="image" uuid="01e1bbd8-d575-4619-9315-afa82edb0308"/>
Nov 08 15:20:41 user nova-compute[74788]:       <nova:ports>
Nov 08 15:20:41 user nova-compute[74788]:         <nova:port uuid="dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d">
Nov 08 15:20:41 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:20:41 user nova-compute[74788]:         </nova:port>
Nov 08 15:20:41 user nova-compute[74788]:       </nova:ports>
Nov 08 15:20:41 user nova-compute[74788]:     </nova:instance>
Nov 08 15:20:41 user nova-compute[74788]:   </metadata>
Nov 08 15:20:41 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:20:41 user nova-compute[74788]:     <system>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="serial">bf5695e6-02aa-4093-a556-a62e367b5925</entry>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="uuid">bf5695e6-02aa-4093-a556-a62e367b5925</entry>
Nov 08 15:20:41 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:20:41 user nova-compute[74788]:     </system>
Nov 08 15:20:41 user nova-compute[74788]:   </sysinfo>
Nov 08 15:20:41 user nova-compute[74788]:   <os>
Nov 08 15:20:41 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:20:41 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:20:41 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:20:41 user nova-compute[74788]:   </os>
Nov 08 15:20:41 user nova-compute[74788]:   <features>
Nov 08 15:20:41 user nova-compute[74788]:     <acpi/>
Nov 08 15:20:41 user nova-compute[74788]:     <apic/>
Nov 08 15:20:41 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:20:41 user nova-compute[74788]:   </features>
Nov 08 15:20:41 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:20:41 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:20:41 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:20:41 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:20:41 user nova-compute[74788]:   </clock>
Nov 08 15:20:41 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:20:41 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:20:41 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:20:41 user nova-compute[74788]:   </cpu>
Nov 08 15:20:41 user nova-compute[74788]:   <devices>
Nov 08 15:20:41 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:20:41 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:20:41 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk"/>
Nov 08 15:20:41 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:20:41 user nova-compute[74788]:     </disk>
Nov 08 15:20:41 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:20:41 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:20:41 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:20:41 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:20:41 user nova-compute[74788]:       <serial>217040bd-423d-46a4-a6d8-c7e2a762afcf</serial>
Nov 08 15:20:41 user nova-compute[74788]:     </disk>
Nov 08 15:20:41 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:20:41 user nova-compute[74788]:       <mac address="fa:16:3e:17:6f:8c"/>
Nov 08 15:20:41 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:41 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:20:41 user nova-compute[74788]:       <target dev="tapdcf6e7bf-d4"/>
Nov 08 15:20:41 user nova-compute[74788]:     </interface>
Nov 08 15:20:41 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:20:41 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/console.log" append="off"/>
Nov 08 15:20:41 user nova-compute[74788]:     </serial>
Nov 08 15:20:41 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:20:41 user nova-compute[74788]:     <video>
Nov 08 15:20:41 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:41 user nova-compute[74788]:     </video>
Nov 08 15:20:41 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:20:41 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:20:41 user nova-compute[74788]:     </rng>
Nov 08 15:20:41 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:20:41 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:20:41 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:20:41 user nova-compute[74788]:     </memballoon>
Nov 08 15:20:41 user nova-compute[74788]:   </devices>
Nov 08 15:20:41 user nova-compute[74788]: </domain>
Nov 08 15:20:41 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.objects.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Object Instance<bf5695e6-02aa-4093-a556-a62e367b5925> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462 --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:20:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.845s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Cannot resize image /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'migration_context' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=25.51941680908203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.objects.base [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Object Instance<bf5695e6-02aa-4093-a556-a62e367b5925> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG os_vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e90414cd-a3ee-5f94-834e-df11e7e0df04', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcf6e7bf-d4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcf6e7bf-d4, col_values=(('qos', UUID('8bd4bc12-a51b-4f79-bd02-a289d89ba48d')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcf6e7bf-d4, col_values=(('external_ids', {'iface-id': 'dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:6f:8c', 'vm-uuid': 'bf5695e6-02aa-4093-a556-a62e367b5925'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:42 user nova-compute[74788]: INFO os_vif [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4')
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d4cedbd-4e31-4aad-a580-da6aded0134f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance bf5695e6-02aa-4093-a556-a62e367b5925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69dab681-c97f-4e62-8fbd-80af3ff55df0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:20:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:20:43 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:43 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:20:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:44 user nova-compute[74788]: WARNING nova.compute.manager [req-790118f8-ad17-4d13-b3ce-00a24d5667ba req-6e55a9d1-59d9-452f-8daf-4c9d6529d122 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state active and task_state reboot_started_hard.
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:46 user nova-compute[74788]: WARNING nova.compute.manager [req-95c70137-3ebe-4470-b8b4-82cbf398291a req-9c0fbadc-c0bb-444f-8a16-187d9f8d1d73 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state active and task_state reboot_started_hard.
Nov 08 15:20:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:20:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance rebooted successfully.
Nov 08 15:20:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2015e868-7e4b-4b08-b7c0-fde9cffb3d4c tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.798s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:20:47 user nova-compute[74788]: INFO nova.compute.claims [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Claim successful on node user
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:20:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:20:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.policy [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '471971c5b22e403cb5b2f573b54f8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599044705f5d49f19ef319ebc7b8f04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:20:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Creating image(s)
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "/opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "/opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk 1073741824" returned: 0 in 0.067s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Successfully created port: 3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.243s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Cannot resize image /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Ensure instance console log exists: /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Successfully updated port: 3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquired lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-changed-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Refreshing instance network info cache due to event network-changed-3634a657-2985-4d87-b144-2a2145173757. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] Acquiring lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Updating instance_info_cache with network_info: [{"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Releasing lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Instance network_info: |[{"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] Acquired lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Refreshing network info cache for port 3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Start _get_guest_xml network_info=[{"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:20:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1240396809',display_name='tempest-VolumesActionsTest-instance-1240396809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1240396809',id=21,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-c2q3kiq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:48Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=2d882e66-2691-4939-9e9e-eec036979cd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d882e66-2691-4939-9e9e-eec036979cd6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:20:49 user nova-compute[74788]:   <uuid>2d882e66-2691-4939-9e9e-eec036979cd6</uuid>
Nov 08 15:20:49 user nova-compute[74788]:   <name>instance-00000015</name>
Nov 08 15:20:49 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:20:49 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:20:49 user nova-compute[74788]:   <metadata>
Nov 08 15:20:49 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:20:49 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:name>tempest-VolumesActionsTest-instance-1240396809</nova:name>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:20:49</nova:creationTime>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:20:49 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:20:49 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:owner>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:user uuid="471971c5b22e403cb5b2f573b54f8a3d">tempest-VolumesActionsTest-736158225-project-member</nova:user>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:project uuid="599044705f5d49f19ef319ebc7b8f04c">tempest-VolumesActionsTest-736158225</nova:project>
Nov 08 15:20:49 user nova-compute[74788]:       </nova:owner>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:20:49 user nova-compute[74788]:       <nova:ports>
Nov 08 15:20:49 user nova-compute[74788]:         <nova:port uuid="3634a657-2985-4d87-b144-2a2145173757">
Nov 08 15:20:49 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 15:20:49 user nova-compute[74788]:         </nova:port>
Nov 08 15:20:49 user nova-compute[74788]:       </nova:ports>
Nov 08 15:20:49 user nova-compute[74788]:     </nova:instance>
Nov 08 15:20:49 user nova-compute[74788]:   </metadata>
Nov 08 15:20:49 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:20:49 user nova-compute[74788]:     <system>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="serial">2d882e66-2691-4939-9e9e-eec036979cd6</entry>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="uuid">2d882e66-2691-4939-9e9e-eec036979cd6</entry>
Nov 08 15:20:49 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:20:49 user nova-compute[74788]:     </system>
Nov 08 15:20:49 user nova-compute[74788]:   </sysinfo>
Nov 08 15:20:49 user nova-compute[74788]:   <os>
Nov 08 15:20:49 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:20:49 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:20:49 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:20:49 user nova-compute[74788]:   </os>
Nov 08 15:20:49 user nova-compute[74788]:   <features>
Nov 08 15:20:49 user nova-compute[74788]:     <acpi/>
Nov 08 15:20:49 user nova-compute[74788]:     <apic/>
Nov 08 15:20:49 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:20:49 user nova-compute[74788]:   </features>
Nov 08 15:20:49 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:20:49 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:20:49 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:20:49 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:20:49 user nova-compute[74788]:   </clock>
Nov 08 15:20:49 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:20:49 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:20:49 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:20:49 user nova-compute[74788]:   </cpu>
Nov 08 15:20:49 user nova-compute[74788]:   <devices>
Nov 08 15:20:49 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:20:49 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:20:49 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk"/>
Nov 08 15:20:49 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:20:49 user nova-compute[74788]:     </disk>
Nov 08 15:20:49 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:20:49 user nova-compute[74788]:       <mac address="fa:16:3e:e0:4b:5c"/>
Nov 08 15:20:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:49 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:20:49 user nova-compute[74788]:       <target dev="tap3634a657-29"/>
Nov 08 15:20:49 user nova-compute[74788]:     </interface>
Nov 08 15:20:49 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:20:49 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/console.log" append="off"/>
Nov 08 15:20:49 user nova-compute[74788]:     </serial>
Nov 08 15:20:49 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:20:49 user nova-compute[74788]:     <video>
Nov 08 15:20:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:20:49 user nova-compute[74788]:     </video>
Nov 08 15:20:49 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:20:49 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:20:49 user nova-compute[74788]:     </rng>
Nov 08 15:20:49 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:20:49 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:20:49 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:20:49 user nova-compute[74788]:     </memballoon>
Nov 08 15:20:49 user nova-compute[74788]:   </devices>
Nov 08 15:20:49 user nova-compute[74788]: </domain>
Nov 08 15:20:49 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1240396809',display_name='tempest-VolumesActionsTest-instance-1240396809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1240396809',id=21,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-c2q3kiq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:48Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=2d882e66-2691-4939-9e9e-eec036979cd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG os_vif [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b667750a-4160-59c5-a700-ebb62b5626b1', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3634a657-29, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3634a657-29, col_values=(('qos', UUID('f9f51f03-8cc1-40cd-a137-01c38aa912e7')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3634a657-29, col_values=(('external_ids', {'iface-id': '3634a657-2985-4d87-b144-2a2145173757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:4b:5c', 'vm-uuid': '2d882e66-2691-4939-9e9e-eec036979cd6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:49 user nova-compute[74788]: INFO os_vif [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29')
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:20:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] No VIF found with MAC fa:16:3e:e0:4b:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:20:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Updated VIF entry in instance network info cache for port 3634a657-2985-4d87-b144-2a2145173757. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:20:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Updating instance_info_cache with network_info: [{"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f9dd061f-c928-493b-9c1b-ff0016013b7c req-70c0d98f-bd22-411d-8469-d2ac47f88039 service nova] Releasing lock "refresh_cache-2d882e66-2691-4939-9e9e-eec036979cd6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] No waiting events found dispatching network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:51 user nova-compute[74788]: WARNING nova.compute.manager [req-21176076-4a22-4077-bffe-3da75da5cba6 req-caa49304-b0ab-4adc-9a62-b424fe1aa920 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received unexpected event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 for instance with vm_state building and task_state spawning.
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:53 user nova-compute[74788]: INFO nova.compute.manager [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Terminating instance
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-5265910f-5d5b-40b4-8cdf-ea8bcf8211f8 req-ff1a5c29-46e8-43aa-be4a-8523e206326f service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-unplugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.013s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] No waiting events found dispatching network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:53 user nova-compute[74788]: WARNING nova.compute.manager [req-17209c70-2641-4443-8ebf-96469dc9c762 req-59a08b69-1253-457d-b026-b5e86d090df4 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received unexpected event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 for instance with vm_state building and task_state spawning.
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Instance destroyed successfully.
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lazy-loading 'resources' on Instance uuid 4d4cedbd-4e31-4aad-a580-da6aded0134f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1076661114',display_name='tempest-ServerActionsTestOtherB-server-1076661114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1076661114',id=1,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5P2Mt1s0UXPc9yikgD+RfTulFpYpqTkRTJ0CRZTh3iuW+1DA0mTxyGoawzcIIcMzF6+1CklqweAAHXVTaulJ3na7KaQ9FCsxsYwSiWmrk7JMJs9jKy3aylxxrWao9bnw==',key_name='tempest-keypair-288311775',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4931b5b5c3724596ae964178f6683416',ramdisk_id='',reservation_id='r-an34s3zv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-108483217',owner_user_name='tempest-ServerActionsTestOtherB-108483217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4cd49810cc347279c7f97ab21bc9e36',uuid=4d4cedbd-4e31-4aad-a580-da6aded0134f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converting VIF {"id": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "address": "fa:16:3e:31:6b:13", "network": {"id": "6a23899b-65e9-4c4e-9508-406c966d7773", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1443805586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4931b5b5c3724596ae964178f6683416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210c398c-b5", "ovs_interfaceid": "210c398c-b530-47f9-9e1b-e8d1b41f6389", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_vif [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210c398c-b5, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Instance spawned successfully.
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ca0fd7d-695f-4115-8ac6-b01fec990f40) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:54 user nova-compute[74788]: INFO os_vif [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:6b:13,bridge_name='br-int',has_traffic_filtering=True,id=210c398c-b530-47f9-9e1b-e8d1b41f6389,network=Network(6a23899b-65e9-4c4e-9508-406c966d7773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210c398c-b5')
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojykunta', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:20:54 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4767e-35b5-42c7-9cca-09d7b0564be2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:20:54 user nova-compute[74788]: No targets found.
Nov 08 15:20:54 user nova-compute[74788]: iSNS:
Nov 08 15:20:54 user nova-compute[74788]: No targets found.
Nov 08 15:20:54 user nova-compute[74788]: STATIC:
Nov 08 15:20:54 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf
Nov 08 15:20:54 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:20:54 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:20:54 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980
Nov 08 15:20:54 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:20:54 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:20:54 user nova-compute[74788]: FIRMWARE:
Nov 08 15:20:54 user nova-compute[74788]: No targets found.
Nov 08 15:20:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:20:54 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:20:54 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10230b3-b25c-4006-8359-b2cf3157f5b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddd5f9-c629-45f9-8bd3-d0359d08582b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:54 user nova-compute[74788]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 (non-flash)
Nov 08 15:20:54 user nova-compute[74788]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:20:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758581b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5580c5-5dc0-4c35-86d8-c09b7745cd99]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a57691-4f24-4efb-b56b-7cee0211ad03]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.049s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df5efb-a945-4c0d-8796-59ee058bae1c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.compute.manager [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Took 7.51 seconds to build instance.
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6b219ef5-753a-439c-b5d4-feac2a6f4efa tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.670s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51928213-9c9e-45fc-9ad2-41699e8be6d7]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cae7f7-ce99-4426-a259-2f79d552c8e5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323e035-cc93-430e-98c7-f6f36e4bdb1b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260]
Nov 08 15:20:54 user nova-compute[74788]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980, portal: 172.16.0.220,3260] successful.
Nov 08 15:20:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb139de-2a58-465f-8eb8-607ab11ae980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2139cac-acca-4bf7-a55a-fb5106ba73b2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.518s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] <== disconnect_volume: return (520ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Deleting instance files /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_del
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Deletion of /opt/stack/data/nova/instances/4d4cedbd-4e31-4aad-a580-da6aded0134f_del complete
Nov 08 15:20:54 user nova-compute[74788]: INFO nova.compute.manager [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Took 1.67 seconds to destroy the instance on the hypervisor.
Nov 08 15:20:54 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:20:54 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:20:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] Acquiring lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] No waiting events found dispatching network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:20:55 user nova-compute[74788]: WARNING nova.compute.manager [req-639fd545-1b50-4ed7-b719-3e6565d98f26 req-0f881c93-0066-4ce3-a4cb-8a506bf115ff service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received unexpected event network-vif-plugged-210c398c-b530-47f9-9e1b-e8d1b41f6389 for instance with vm_state active and task_state deleting.
Nov 08 15:20:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:20:56 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Took 1.51 seconds to deallocate network for instance.
Nov 08 15:20:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:57 user nova-compute[74788]: INFO nova.compute.manager [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Took 0.99 seconds to detach 1 volumes for instance.
Nov 08 15:20:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:20:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:20:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-247e72e3-5a92-4638-aeb0-150fca1e17d5 req-cfd5df0c-0380-4d81-9497-13ba2787e028 service nova] [instance: 4d4cedbd-4e31-4aad-a580-da6aded0134f] Received event network-vif-deleted-210c398c-b530-47f9-9e1b-e8d1b41f6389 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:20:57 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:20:58 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:20:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:58 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Deleted allocations for instance 4d4cedbd-4e31-4aad-a580-da6aded0134f
Nov 08 15:20:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f970d1b5-fc84-4516-aa8a-2eecf1ba9f25 tempest-ServerActionsTestOtherB-108483217 tempest-ServerActionsTestOtherB-108483217-project-member] Lock "4d4cedbd-4e31-4aad-a580-da6aded0134f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.005s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:20:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:20:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquired lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'info_cache' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:00 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Releasing lock "refresh_cache-16d4b216-2642-4df7-b0dd-a8b7da36b88e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:01 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance destroyed successfully.
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'resources' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG os_vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64118033-36, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=751f793a-ab2e-4771-ad0a-8b5c7a778e42) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:01 user nova-compute[74788]: INFO os_vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start _get_guest_xml network_info=[{"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'numa_topology' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:21:01 user nova-compute[74788]:   <uuid>16d4b216-2642-4df7-b0dd-a8b7da36b88e</uuid>
Nov 08 15:21:01 user nova-compute[74788]:   <name>instance-00000002</name>
Nov 08 15:21:01 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:21:01 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:21:01 user nova-compute[74788]:   <metadata>
Nov 08 15:21:01 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:21:01 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeTestJSON-server-70773012</nova:name>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:21:01</nova:creationTime>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:21:01 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:21:01 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:owner>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:user uuid="649a41ab82754c269c03606c18428b86">tempest-AttachVolumeTestJSON-1302335670-project-member</nova:user>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:project uuid="7984a5e14b104fdbbe50c0171702b765">tempest-AttachVolumeTestJSON-1302335670</nova:project>
Nov 08 15:21:01 user nova-compute[74788]:       </nova:owner>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:21:01 user nova-compute[74788]:       <nova:ports>
Nov 08 15:21:01 user nova-compute[74788]:         <nova:port uuid="64118033-36fd-4778-a574-53d4a32ec9c1">
Nov 08 15:21:01 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:21:01 user nova-compute[74788]:         </nova:port>
Nov 08 15:21:01 user nova-compute[74788]:       </nova:ports>
Nov 08 15:21:01 user nova-compute[74788]:     </nova:instance>
Nov 08 15:21:01 user nova-compute[74788]:   </metadata>
Nov 08 15:21:01 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:21:01 user nova-compute[74788]:     <system>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="serial">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="uuid">16d4b216-2642-4df7-b0dd-a8b7da36b88e</entry>
Nov 08 15:21:01 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:21:01 user nova-compute[74788]:     </system>
Nov 08 15:21:01 user nova-compute[74788]:   </sysinfo>
Nov 08 15:21:01 user nova-compute[74788]:   <os>
Nov 08 15:21:01 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:21:01 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:21:01 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:21:01 user nova-compute[74788]:   </os>
Nov 08 15:21:01 user nova-compute[74788]:   <features>
Nov 08 15:21:01 user nova-compute[74788]:     <acpi/>
Nov 08 15:21:01 user nova-compute[74788]:     <apic/>
Nov 08 15:21:01 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:21:01 user nova-compute[74788]:   </features>
Nov 08 15:21:01 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:21:01 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:21:01 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:21:01 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:21:01 user nova-compute[74788]:   </clock>
Nov 08 15:21:01 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:21:01 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:21:01 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:21:01 user nova-compute[74788]:   </cpu>
Nov 08 15:21:01 user nova-compute[74788]:   <devices>
Nov 08 15:21:01 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:21:01 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:21:01 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk"/>
Nov 08 15:21:01 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:21:01 user nova-compute[74788]:     </disk>
Nov 08 15:21:01 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:21:01 user nova-compute[74788]:       <mac address="fa:16:3e:35:3e:45"/>
Nov 08 15:21:01 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:21:01 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:21:01 user nova-compute[74788]:       <target dev="tap64118033-36"/>
Nov 08 15:21:01 user nova-compute[74788]:     </interface>
Nov 08 15:21:01 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:21:01 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/console.log" append="off"/>
Nov 08 15:21:01 user nova-compute[74788]:     </serial>
Nov 08 15:21:01 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:21:01 user nova-compute[74788]:     <video>
Nov 08 15:21:01 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:21:01 user nova-compute[74788]:     </video>
Nov 08 15:21:01 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:21:01 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:21:01 user nova-compute[74788]:     </rng>
Nov 08 15:21:01 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:21:01 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:21:01 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:21:01 user nova-compute[74788]:     </memballoon>
Nov 08 15:21:01 user nova-compute[74788]:   </devices>
Nov 08 15:21:01 user nova-compute[74788]: </domain>
Nov 08 15:21:01 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.220s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:21:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Cannot resize image /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'migration_context' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.objects.base [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Object Instance<16d4b216-2642-4df7-b0dd-a8b7da36b88e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG os_vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbcf4317-c202-50ae-8943-fd435724e94e', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64118033-36, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64118033-36, col_values=(('qos', UUID('d92c25ca-5cc0-419c-816c-78f3a41640d3')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64118033-36, col_values=(('external_ids', {'iface-id': '64118033-36fd-4778-a574-53d4a32ec9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3e:45', 'vm-uuid': '16d4b216-2642-4df7-b0dd-a8b7da36b88e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:02 user nova-compute[74788]: INFO os_vif [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:21:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing instance network info cache due to event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated VIF entry in instance network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f5e484e-f412-470f-ba4d-a51ea6d1accb req-53b29922-ca92-45ee-b152-7c1f21c43d2c service nova] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:06 user nova-compute[74788]: WARNING nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state powering-on.
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:06 user nova-compute[74788]: WARNING nova.compute.manager [req-e06863de-d6c2-4241-959e-1542a83936ba req-d7ae7356-2ca3-4da9-ab5f-377c240c137f service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state stopped and task_state powering-on.
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:21:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance rebooted successfully.
Nov 08 15:21:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cf57d8a8-a717-4a08-88a2-11631021d4c2 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:21:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG nova.objects.instance [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lazy-loading 'flavor' on Instance uuid 69dab681-c97f-4e62-8fbd-80af3ff55df0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:17 user nova-compute[74788]: INFO nova.compute.manager [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Attaching volume 707a9880-4fd2-422c-98c0-56c1dc0a782b to /dev/vdb
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.utils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c0f62-a0be-4828-a82d-ad7e59069bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db950a-2fef-49bc-ac03-f4b52265f3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b24bdd-cc99-4287-84c0-435a5efba4b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d68d6-5897-4d3b-85a5-e09912c28f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:21:17 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:21:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9287726-e2d7-4a0c-8efc-a9df45a4c6bd]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG os_brick.utils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:21:17 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Updating existing volume attachment record: bcf1a1cf-5779-4073-98cf-e6e1ff45eac9 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:21:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:21:34 user nova-compute[74788]: INFO nova.compute.claims [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Claim successful on node user
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:21:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:21:34 user nova-compute[74788]: DEBUG nova.policy [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4568bc1060d24fceba63059e683444bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2ea0f041204b63b39a09e275b340cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:21:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Creating image(s)
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "/opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "/opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.282s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk 1073741824" returned: 0 in 0.054s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Cannot resize image /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Ensure instance console log exists: /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Successfully created port: e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Successfully updated port: e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquired lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing instance network info cache due to event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] Acquiring lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:36 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Releasing lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Instance network_info: |[{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] Acquired lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Start _get_guest_xml network_info=[{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:21:37 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:37 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-725645277',display_name='tempest-TestStampPattern-server-725645277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-725645277',id=22,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-gxkq2obd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:21:35Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=ce357a1e-6baf-4309-8227-6b2c77d2bfe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.objects.instance [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'pci_devices' on Instance uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:21:37 user nova-compute[74788]:   <uuid>ce357a1e-6baf-4309-8227-6b2c77d2bfe6</uuid>
Nov 08 15:21:37 user nova-compute[74788]:   <name>instance-00000016</name>
Nov 08 15:21:37 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:21:37 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:21:37 user nova-compute[74788]:   <metadata>
Nov 08 15:21:37 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:21:37 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:name>tempest-TestStampPattern-server-725645277</nova:name>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:21:37</nova:creationTime>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:21:37 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:21:37 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:owner>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:user uuid="4568bc1060d24fceba63059e683444bd">tempest-TestStampPattern-242603636-project-member</nova:user>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:project uuid="ef2ea0f041204b63b39a09e275b340cc">tempest-TestStampPattern-242603636</nova:project>
Nov 08 15:21:37 user nova-compute[74788]:       </nova:owner>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:21:37 user nova-compute[74788]:       <nova:ports>
Nov 08 15:21:37 user nova-compute[74788]:         <nova:port uuid="e864e81d-d297-4d94-b65f-e445aff7c3bc">
Nov 08 15:21:37 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 15:21:37 user nova-compute[74788]:         </nova:port>
Nov 08 15:21:37 user nova-compute[74788]:       </nova:ports>
Nov 08 15:21:37 user nova-compute[74788]:     </nova:instance>
Nov 08 15:21:37 user nova-compute[74788]:   </metadata>
Nov 08 15:21:37 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:21:37 user nova-compute[74788]:     <system>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="serial">ce357a1e-6baf-4309-8227-6b2c77d2bfe6</entry>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="uuid">ce357a1e-6baf-4309-8227-6b2c77d2bfe6</entry>
Nov 08 15:21:37 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:21:37 user nova-compute[74788]:     </system>
Nov 08 15:21:37 user nova-compute[74788]:   </sysinfo>
Nov 08 15:21:37 user nova-compute[74788]:   <os>
Nov 08 15:21:37 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:21:37 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:21:37 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:21:37 user nova-compute[74788]:   </os>
Nov 08 15:21:37 user nova-compute[74788]:   <features>
Nov 08 15:21:37 user nova-compute[74788]:     <acpi/>
Nov 08 15:21:37 user nova-compute[74788]:     <apic/>
Nov 08 15:21:37 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:21:37 user nova-compute[74788]:   </features>
Nov 08 15:21:37 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:21:37 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:21:37 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:21:37 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:21:37 user nova-compute[74788]:   </clock>
Nov 08 15:21:37 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:21:37 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:21:37 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:21:37 user nova-compute[74788]:   </cpu>
Nov 08 15:21:37 user nova-compute[74788]:   <devices>
Nov 08 15:21:37 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:21:37 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:21:37 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk"/>
Nov 08 15:21:37 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:21:37 user nova-compute[74788]:     </disk>
Nov 08 15:21:37 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:21:37 user nova-compute[74788]:       <mac address="fa:16:3e:f1:7d:51"/>
Nov 08 15:21:37 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:21:37 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:21:37 user nova-compute[74788]:       <target dev="tape864e81d-d2"/>
Nov 08 15:21:37 user nova-compute[74788]:     </interface>
Nov 08 15:21:37 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:21:37 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/console.log" append="off"/>
Nov 08 15:21:37 user nova-compute[74788]:     </serial>
Nov 08 15:21:37 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:21:37 user nova-compute[74788]:     <video>
Nov 08 15:21:37 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:21:37 user nova-compute[74788]:     </video>
Nov 08 15:21:37 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:21:37 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:21:37 user nova-compute[74788]:     </rng>
Nov 08 15:21:37 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:21:37 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:21:37 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:21:37 user nova-compute[74788]:     </memballoon>
Nov 08 15:21:37 user nova-compute[74788]:   </devices>
Nov 08 15:21:37 user nova-compute[74788]: </domain>
Nov 08 15:21:37 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-725645277',display_name='tempest-TestStampPattern-server-725645277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-725645277',id=22,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-gxkq2obd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:21:35Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=ce357a1e-6baf-4309-8227-6b2c77d2bfe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG os_vif [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17944785-2d62-51b8-86f2-2c5ea252bb05', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape864e81d-d2, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape864e81d-d2, col_values=(('qos', UUID('e3552df9-88f1-4e78-80de-1f94ceec41c6')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape864e81d-d2, col_values=(('external_ids', {'iface-id': 'e864e81d-d297-4d94-b65f-e445aff7c3bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:7d:51', 'vm-uuid': 'ce357a1e-6baf-4309-8227-6b2c77d2bfe6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:37 user nova-compute[74788]: INFO os_vif [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2')
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No VIF found with MAC fa:16:3e:f1:7d:51, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updated VIF entry in instance network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826121b9-a79c-4187-9d3e-8e44f526a991 req-7e544dcb-0c67-4170-878b-c82d113f6e12 service nova] Releasing lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing instance network info cache due to event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updated VIF entry in instance network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-235085d2-83bd-49c4-a739-aa4ae458fbb6 req-e69de70f-53df-4b4f-ab78-bb9ef800719b service nova] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] No waiting events found dispatching network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:40 user nova-compute[74788]: WARNING nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received unexpected event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc for instance with vm_state building and task_state spawning.
Nov 08 15:21:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] No waiting events found dispatching network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:40 user nova-compute[74788]: WARNING nova.compute.manager [req-02a98ffd-b23a-4f5a-8b41-dc9fca6571ee req-f8e79578-47c2-47da-b20c-a95d2fc3d2fa service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received unexpected event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc for instance with vm_state building and task_state spawning.
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:21:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Instance spawned successfully.
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:41 user nova-compute[74788]: INFO nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:21:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7169MB free_disk=25.438190460205078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:41 user nova-compute[74788]: INFO nova.compute.manager [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Took 7.67 seconds to build instance.
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-02c663d5-70c7-44ff-a489-953eb22da8e6 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.783s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance bf5695e6-02aa-4093-a556-a62e367b5925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69dab681-c97f-4e62-8fbd-80af3ff55df0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2d882e66-2691-4939-9e9e-eec036979cd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNqoXHyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:21:41 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:21:41 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:21:41 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b485f-157d-42ef-bf41-30ba7ec6b713]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:21:41 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[53554a8c-b1d7-4a7b-8c43-1c35048d6de7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b] added
Nov 08 15:21:41 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8fcd0-5f2a-4e90-aeac-9fa6a69608f3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea835f84-8a64-4ef5-8ad1-8def88fd5b81]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNqoXHyM {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNqoXHyM" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5139504d-e4dd-43b0-937e-0f52e90cf844]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNqoXHyM'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b288d-58f2-4273-aa60-55758b240de8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ebba9-3f27-4cf8-b179-37d46e75a5a7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb353a1-54e1-4510-8bdb-4857fb20d107]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260]
Nov 08 15:21:42 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260] successful.
Nov 08 15:21:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284bd77-3c9b-4820-ae92-1169135fc780]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b089d9df-de88-44f8-bdf3-cf6835e8af73]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:42 user nova-compute[74788]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)
Nov 08 15:21:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:42 user nova-compute[74788]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)
Nov 08 15:21:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.076s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[842847eb-7b62-43b2-b614-2935ebaa78d1]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNqoXHyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26537316231336336', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316231336336', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lazy-loading 'flavor' on Instance uuid 69dab681-c97f-4e62-8fbd-80af3ff55df0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:21:43 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:21:43 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:21:43 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:21:43 user nova-compute[74788]:   <serial>707a9880-4fd2-422c-98c0-56c1dc0a782b</serial>
Nov 08 15:21:43 user nova-compute[74788]: </disk>
Nov 08 15:21:43 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:21:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] No VIF found with MAC fa:16:3e:b4:eb:e8, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-749ed59b-2a76-4e6b-a7a0-d4e1392eb8b0 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.518s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:44 user nova-compute[74788]: INFO nova.compute.manager [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Terminating instance
Nov 08 15:21:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-unplugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] No waiting events found dispatching network-vif-unplugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-72ef1493-d6f8-4541-ab0a-c57702d116bc req-b86b42b4-f954-4bbb-8cad-205da2d65c03 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-unplugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:21:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Instance destroyed successfully.
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lazy-loading 'resources' on Instance uuid 69dab681-c97f-4e62-8fbd-80af3ff55df0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2073173589',display_name='tempest-DeleteServersTestJSON-server-2073173589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2073173589',id=16,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7b335769914fa3b8937f2ec7d0838e',ramdisk_id='',reservation_id='r-hniws75o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1202393964',owner_user_name='tempest-DeleteServersTestJSON-1202393964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:19:27Z,user_data=None,user_id='819d9ebc3f50429ba373b0e9a024e8e5',uuid=69dab681-c97f-4e62-8fbd-80af3ff55df0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converting VIF {"id": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "address": "fa:16:3e:b4:eb:e8", "network": {"id": "0fdfcf90-cb4c-4598-8365-6d3b71b4acfb", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-484798281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7b335769914fa3b8937f2ec7d0838e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9bbaa2-7a", "ovs_interfaceid": "6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_vif [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9bbaa2-7a, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12290302-409f-406a-9af0-bec070d998d3) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:45 user nova-compute[74788]: INFO os_vif [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:eb:e8,bridge_name='br-int',has_traffic_filtering=True,id=6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0,network=Network(0fdfcf90-cb4c-4598-8365-6d3b71b4acfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9bbaa2-7a')
Nov 08 15:21:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNqoXHyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:21:45 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e9cd7-3786-4db9-b372-2fb2e891dc05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:21:45 user nova-compute[74788]: No targets found.
Nov 08 15:21:45 user nova-compute[74788]: iSNS:
Nov 08 15:21:45 user nova-compute[74788]: No targets found.
Nov 08 15:21:45 user nova-compute[74788]: STATIC:
Nov 08 15:21:45 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf
Nov 08 15:21:45 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:21:45 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:21:45 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b
Nov 08 15:21:45 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:21:45 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:21:45 user nova-compute[74788]: FIRMWARE:
Nov 08 15:21:45 user nova-compute[74788]: No targets found.
Nov 08 15:21:45 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:21:45 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:21:45 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a7dd0-eca6-4427-81b0-2bced9cac34c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48debc8-46ba-4836-a3b7-90b213cfc210]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:45 user nova-compute[74788]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)
Nov 08 15:21:45 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:21:45 user nova-compute[74788]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b (non-flash)
Nov 08 15:21:45 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758488a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35cd5c7-71bf-49eb-bf0c-ce3d3bbbdaf8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f5c3d6-323c-41ef-b48e-abae2ff432c5]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[97176a26-0473-41a3-a801-a5a986bd4eea]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:21:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c421e170-5df0-4084-89ca-3dd64bcedf97]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[862556b8-3f2e-4e9d-ab68-4cb7579275fd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f75aa-cc96-49ae-806a-35ad883d03ae]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260]
Nov 08 15:21:46 user nova-compute[74788]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b, portal: 172.16.0.220,3260] successful.
Nov 08 15:21:46 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:707a9880-4fd2-422c-98c0-56c1dc0a782b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cd0c5f-bc02-458f-860b-c079fd1c8fbf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] <== disconnect_volume: return (348ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:21:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Deleting instance files /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0_del
Nov 08 15:21:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Deletion of /opt/stack/data/nova/instances/69dab681-c97f-4e62-8fbd-80af3ff55df0_del complete
Nov 08 15:21:46 user nova-compute[74788]: INFO nova.compute.manager [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 08 15:21:46 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:21:46 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:46 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Took 0.54 seconds to deallocate network for instance.
Nov 08 15:21:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-c7cfe6d0-a84c-46fc-85f4-58aaa1e025b8 req-6ca20bd0-1e0c-4256-81d7-1c4d030016d0 service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-deleted-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] Acquiring lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] No waiting events found dispatching network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:47 user nova-compute[74788]: WARNING nova.compute.manager [req-e366051d-67c2-4fad-8400-c127ae945321 req-2984d585-32fa-4086-8874-234067a251af service nova] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Received unexpected event network-vif-plugged-6a9bbaa2-7a94-44a9-9cf5-4f9e397a3fb0 for instance with vm_state active and task_state deleting.
Nov 08 15:21:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:47 user nova-compute[74788]: INFO nova.compute.manager [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] [instance: 69dab681-c97f-4e62-8fbd-80af3ff55df0] Took 1.04 seconds to detach 1 volumes for instance.
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:47 user nova-compute[74788]: INFO nova.compute.manager [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Shelving
Nov 08 15:21:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:48 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:21:48 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:21:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:48 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Deleted allocations for instance 69dab681-c97f-4e62-8fbd-80af3ff55df0
Nov 08 15:21:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cbe4dd7c-dd37-44b6-aab2-326111f42f42 tempest-DeleteServersTestJSON-1202393964 tempest-DeleteServersTestJSON-1202393964-project-member] Lock "69dab681-c97f-4e62-8fbd-80af3ff55df0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.812s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance destroyed successfully.
Nov 08 15:21:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Beginning cold snapshot process
Nov 08 15:21:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:49 user nova-compute[74788]: WARNING nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state active and task_state shelving.
Nov 08 15:21:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:21:49 user nova-compute[74788]: WARNING nova.compute.manager [req-5a1ef3d5-f929-49c7-8f4e-2f7a30d4594d req-d3766610-7028-4407-b227-b0d6233ce4f4 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state active and task_state shelving.
Nov 08 15:21:49 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk /opt/stack/data/nova/instances/snapshots/tmpac3su3aw/05d64b8d69da4b89a550d30c5c6ff376 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:21:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk /opt/stack/data/nova/instances/snapshots/tmpac3su3aw/05d64b8d69da4b89a550d30c5c6ff376" returned: 0 in 0.800s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:21:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Snapshot extracted, beginning image upload
Nov 08 15:21:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:21:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Snapshot image upload complete
Nov 08 15:21:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:21:53 user nova-compute[74788]: INFO nova.compute.manager [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Shelve offloading
Nov 08 15:21:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance destroyed successfully.
Nov 08 15:21:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:21:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:21:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance destroyed successfully.
Nov 08 15:21:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'resources' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwypp1+8dqzzWKrglx0S05tZL9dCcJrjeCyAUldZ8pXOhaThF/DqUrfT7pCM2CPJX2YwUx7FPEawhmk1uoIQR9v6zmQPEBG82ScolKxKeHtXkYk1J/bCxKdHUTVfRcgnw==',key_name='tempest-keypair-1161035840',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:21:53.322456',shelved_host='user',shelved_image_id='fd54803a-721f-4c2e-89d5-950d32ab5ca0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG os_vif [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1e7383-ef, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3f51835-146c-44ed-a490-f457cf00b3b7) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:21:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:21:54 user nova-compute[74788]: INFO os_vif [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef')
Nov 08 15:21:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Deleting instance files /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d_del
Nov 08 15:21:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Deletion of /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d_del complete
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing instance network info cache due to event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.network.neutron [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:21:55 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Deleted allocations for instance 751fb539-5e41-405a-af55-40a54d1ce66d
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'numa_topology' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.objects.base [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<751fb539-5e41-405a-af55-40a54d1ce66d> lazy-loaded attributes: resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.network.neutron [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updated VIF entry in instance network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.network.neutron [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d78a7a4-0054-417a-bba0-fa15730d62f3 req-108f913e-41d9-4f43-b451-d2ae0f28e0b8 service nova] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a7f68eed-9a35-4b5c-9949-2a4edfb92f34 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.924s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:21:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:21:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:02 user nova-compute[74788]: INFO nova.compute.manager [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Terminating instance
Nov 08 15:22:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:22:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Instance destroyed successfully.
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lazy-loading 'resources' on Instance uuid d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1530679016',display_name='tempest-ServersNegativeTestJSON-server-1530679016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1530679016',id=18,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:20:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-olkopwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:20:20Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "address": "fa:16:3e:4a:9c:3d", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdb4d366-80", "ovs_interfaceid": "cdb4d366-80fe-492d-8088-cb9c35ee39f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG os_vif [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdb4d366-80, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-unplugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] No waiting events found dispatching network-vif-unplugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-e5b82bd1-f66c-447b-84f2-131629b4b4c8 req-c8226ac3-ff6c-4411-8b3e-f1dee21923b8 service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-unplugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5439eae3-fe98-4fb6-8317-1174f960122b) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:03 user nova-compute[74788]: INFO os_vif [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:9c:3d,bridge_name='br-int',has_traffic_filtering=True,id=cdb4d366-80fe-492d-8088-cb9c35ee39f5,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdb4d366-80')
Nov 08 15:22:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Deleting instance files /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845_del
Nov 08 15:22:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Deletion of /opt/stack/data/nova/instances/d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845_del complete
Nov 08 15:22:03 user nova-compute[74788]: INFO nova.compute.manager [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 15:22:03 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:22:03 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:04 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Took 0.49 seconds to deallocate network for instance.
Nov 08 15:22:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-24fc3f02-a840-4705-aa0b-b160cd04f1a1 req-811c6d92-cefb-492b-8d0a-4897b533b38f service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-deleted-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:22:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:04 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Deleted allocations for instance d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845
Nov 08 15:22:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-794f2104-e4f8-404f-bffe-55a103189193 tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.857s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] Acquiring lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] Lock "d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] No waiting events found dispatching network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:05 user nova-compute[74788]: WARNING nova.compute.manager [req-5e160679-dc68-455c-9dff-3ec045c7622a req-8e4c4e46-f8b7-4cfe-8565-a3100f9008fb service nova] [instance: d62aaa8a-1b07-4eb0-88a3-6bc98ad1a845] Received unexpected event network-vif-plugged-cdb4d366-80fe-492d-8088-cb9c35ee39f5 for instance with vm_state deleted and task_state None.
Nov 08 15:22:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:08 user nova-compute[74788]: INFO nova.compute.manager [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Rescuing
Nov 08 15:22:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:22:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:22:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:22:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:22:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:10 user nova-compute[74788]: WARNING nova.compute.manager [req-0ae965eb-6b3c-4d86-8f36-97836ae83b17 req-aad3e53c-216e-446e-9283-6f8489121ae8 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state active and task_state rescuing.
Nov 08 15:22:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance destroyed successfully.
Nov 08 15:22:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Attempting rescue
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:22:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Creating image(s)
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue" returned: 0 in 0.064s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'migration_context' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.base [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<6a9abf8f-0442-45c7-9d91-2a1c062437d7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start _get_guest_xml network_info=[{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:f4:99:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04773e08-e579-43f8-a159-498093451850', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.base [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<6a9abf8f-0442-45c7-9d91-2a1c062437d7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.base [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<6a9abf8f-0442-45c7-9d91-2a1c062437d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:22:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:22:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.base [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<6a9abf8f-0442-45c7-9d91-2a1c062437d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020246904',display_name='tempest-ServerRescueNegativeTestJSON-server-2020246904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020246904',id=20,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:20:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-0m204bnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:28Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=6a9abf8f-0442-45c7-9d91-2a1c062437d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:f4:99:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:f4:99:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.objects.base [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<6a9abf8f-0442-45c7-9d91-2a1c062437d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:22:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:22:10 user nova-compute[74788]:   <uuid>6a9abf8f-0442-45c7-9d91-2a1c062437d7</uuid>
Nov 08 15:22:10 user nova-compute[74788]:   <name>instance-00000014</name>
Nov 08 15:22:10 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:22:10 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:22:10 user nova-compute[74788]:   <metadata>
Nov 08 15:22:10 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:22:10 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020246904</nova:name>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:22:10</nova:creationTime>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:22:10 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:22:10 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:owner>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:22:10 user nova-compute[74788]:       </nova:owner>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:22:10 user nova-compute[74788]:       <nova:ports>
Nov 08 15:22:10 user nova-compute[74788]:         <nova:port uuid="eaae088b-d477-4248-a868-fe6d7545d647">
Nov 08 15:22:10 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 15:22:10 user nova-compute[74788]:         </nova:port>
Nov 08 15:22:10 user nova-compute[74788]:       </nova:ports>
Nov 08 15:22:10 user nova-compute[74788]:     </nova:instance>
Nov 08 15:22:10 user nova-compute[74788]:   </metadata>
Nov 08 15:22:10 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:22:10 user nova-compute[74788]:     <system>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="serial">6a9abf8f-0442-45c7-9d91-2a1c062437d7</entry>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="uuid">6a9abf8f-0442-45c7-9d91-2a1c062437d7</entry>
Nov 08 15:22:10 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:22:10 user nova-compute[74788]:     </system>
Nov 08 15:22:10 user nova-compute[74788]:   </sysinfo>
Nov 08 15:22:10 user nova-compute[74788]:   <os>
Nov 08 15:22:10 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:22:10 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:22:10 user nova-compute[74788]:   </os>
Nov 08 15:22:10 user nova-compute[74788]:   <features>
Nov 08 15:22:10 user nova-compute[74788]:     <acpi/>
Nov 08 15:22:10 user nova-compute[74788]:     <apic/>
Nov 08 15:22:10 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:22:10 user nova-compute[74788]:   </features>
Nov 08 15:22:10 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:22:10 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:22:10 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:22:10 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:22:10 user nova-compute[74788]:   </clock>
Nov 08 15:22:10 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:22:10 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:22:10 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:22:10 user nova-compute[74788]:   </cpu>
Nov 08 15:22:10 user nova-compute[74788]:   <devices>
Nov 08 15:22:10 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:22:10 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:22:10 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue"/>
Nov 08 15:22:10 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:22:10 user nova-compute[74788]:     </disk>
Nov 08 15:22:10 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:22:10 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:22:10 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk"/>
Nov 08 15:22:10 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:22:10 user nova-compute[74788]:     </disk>
Nov 08 15:22:10 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:22:10 user nova-compute[74788]:       <mac address="fa:16:3e:f4:99:4e"/>
Nov 08 15:22:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:22:10 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:22:10 user nova-compute[74788]:       <target dev="tapeaae088b-d4"/>
Nov 08 15:22:10 user nova-compute[74788]:     </interface>
Nov 08 15:22:10 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:22:10 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/console.log" append="off"/>
Nov 08 15:22:10 user nova-compute[74788]:     </serial>
Nov 08 15:22:10 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:22:10 user nova-compute[74788]:     <video>
Nov 08 15:22:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:22:10 user nova-compute[74788]:     </video>
Nov 08 15:22:10 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:22:10 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:22:10 user nova-compute[74788]:     </rng>
Nov 08 15:22:10 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:22:10 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:22:10 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:22:10 user nova-compute[74788]:     </memballoon>
Nov 08 15:22:10 user nova-compute[74788]:   </devices>
Nov 08 15:22:10 user nova-compute[74788]: </domain>
Nov 08 15:22:10 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:22:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance destroyed successfully.
Nov 08 15:22:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:22:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:22:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:f4:99:4e, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:12 user nova-compute[74788]: WARNING nova.compute.manager [req-f15c0c19-78bc-4ccf-98c0-e661d11c2cee req-8b935d92-2889-4b18-9f65-5cabf95596de service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state active and task_state rescuing.
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:14 user nova-compute[74788]: WARNING nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state active and task_state rescuing.
Nov 08 15:22:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:14 user nova-compute[74788]: WARNING nova.compute.manager [req-c22d3548-8050-441f-ba53-36433dedcf1e req-387082b4-c7df-4653-91c6-7760388afdd6 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state active and task_state rescuing.
Nov 08 15:22:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-1121ff8c-afff-4e11-8051-eda043bf16cc tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:22:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing instance network info cache due to event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:22:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:22:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:22:29 user nova-compute[74788]: DEBUG nova.network.neutron [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.network.neutron [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated VIF entry in instance network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.network.neutron [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c4cf9885-aa13-4e67-8daa-1c44a2676389 req-bbe2facd-2660-4862-9bfc-4ed7c080ee48 service nova] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:30 user nova-compute[74788]: INFO nova.compute.manager [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Detaching volume 217040bd-423d-46a4-a6d8-c7e2a762afcf
Nov 08 15:22:30 user nova-compute[74788]: INFO nova.virt.block_device [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Attempting to driver detach volume 217040bd-423d-46a4-a6d8-c7e2a762afcf from mountpoint /dev/vdb
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Attempting to detach device vdb from instance bf5695e6-02aa-4093-a556-a62e367b5925 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:22:30 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:22:30 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:22:30 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:22:30 user nova-compute[74788]:   <serial>217040bd-423d-46a4-a6d8-c7e2a762afcf</serial>
Nov 08 15:22:30 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:22:30 user nova-compute[74788]: </disk>
Nov 08 15:22:30 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:22:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully detached device vdb from instance bf5695e6-02aa-4093-a556-a62e367b5925 from the persistent domain config.
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf5695e6-02aa-4093-a556-a62e367b5925 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:22:30 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:22:30 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:22:30 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:22:30 user nova-compute[74788]:   <serial>217040bd-423d-46a4-a6d8-c7e2a762afcf</serial>
Nov 08 15:22:30 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:22:30 user nova-compute[74788]: </disk>
Nov 08 15:22:30 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:22:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing instance network info cache due to event network-changed-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] Acquiring lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] Acquired lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.network.neutron [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Refreshing network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.network.neutron [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updated VIF entry in instance network info cache for port dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:22:31 user nova-compute[74788]: DEBUG nova.network.neutron [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [{"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-710c5f7c-7a85-47ad-805c-153fd7becda7 req-e38a7220-314b-4648-ab3c-61ade3b12bb0 service nova] Releasing lock "refresh_cache-bf5695e6-02aa-4093-a556-a62e367b5925" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:22:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:22:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:22:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:22:36 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updating instance_info_cache with network_info: [{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:37 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:22:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.431900024414062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance bf5695e6-02aa-4093-a556-a62e367b5925 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2d882e66-2691-4939-9e9e-eec036979cd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.748s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:22:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:45 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:22:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:48 user nova-compute[74788]: INFO nova.compute.manager [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Terminating instance
Nov 08 15:22:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:22:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-unplugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] No waiting events found dispatching network-vif-unplugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ffb821-17b9-42d1-8b17-7876a735837c req-cadc56f3-dccc-43eb-9b98-5a72c5250ec5 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-unplugged-3634a657-2985-4d87-b144-2a2145173757 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:22:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Instance destroyed successfully.
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lazy-loading 'resources' on Instance uuid 2d882e66-2691-4939-9e9e-eec036979cd6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1240396809',display_name='tempest-VolumesActionsTest-instance-1240396809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1240396809',id=21,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-c2q3kiq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:20:55Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=2d882e66-2691-4939-9e9e-eec036979cd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "3634a657-2985-4d87-b144-2a2145173757", "address": "fa:16:3e:e0:4b:5c", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3634a657-29", "ovs_interfaceid": "3634a657-2985-4d87-b144-2a2145173757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG os_vif [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3634a657-29, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9f51f03-8cc1-40cd-a137-01c38aa912e7) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:49 user nova-compute[74788]: INFO os_vif [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:5c,bridge_name='br-int',has_traffic_filtering=True,id=3634a657-2985-4d87-b144-2a2145173757,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3634a657-29')
Nov 08 15:22:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Deleting instance files /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6_del
Nov 08 15:22:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Deletion of /opt/stack/data/nova/instances/2d882e66-2691-4939-9e9e-eec036979cd6_del complete
Nov 08 15:22:49 user nova-compute[74788]: INFO nova.compute.manager [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 15:22:49 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:22:49 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:22:50 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c6dd0437-9008-404a-bb2b-2a8e75e6c66c req-0319b377-2dd3-486a-877d-57ccbf429b3d service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-deleted-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:50 user nova-compute[74788]: INFO nova.compute.manager [req-c6dd0437-9008-404a-bb2b-2a8e75e6c66c req-0319b377-2dd3-486a-877d-57ccbf429b3d service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Neutron deleted interface 3634a657-2985-4d87-b144-2a2145173757; detaching it from the instance and deleting it from the info cache
Nov 08 15:22:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-c6dd0437-9008-404a-bb2b-2a8e75e6c66c req-0319b377-2dd3-486a-877d-57ccbf429b3d service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:50 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Took 1.26 seconds to deallocate network for instance.
Nov 08 15:22:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c6dd0437-9008-404a-bb2b-2a8e75e6c66c req-0319b377-2dd3-486a-877d-57ccbf429b3d service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Detach interface failed, port_id=3634a657-2985-4d87-b144-2a2145173757, reason: Instance 2d882e66-2691-4939-9e9e-eec036979cd6 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:22:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf5695e6-02aa-4093-a556-a62e367b5925 is timed out.
Nov 08 15:22:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully detached device vdb from instance bf5695e6-02aa-4093-a556-a62e367b5925 from the live domain config.
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmTZHrXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:22:51 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14db5d-6eaa-48ac-baff-de016b2ddf35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:22:51 user nova-compute[74788]: No targets found.
Nov 08 15:22:51 user nova-compute[74788]: iSNS:
Nov 08 15:22:51 user nova-compute[74788]: No targets found.
Nov 08 15:22:51 user nova-compute[74788]: STATIC:
Nov 08 15:22:51 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf
Nov 08 15:22:51 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:22:51 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:22:51 user nova-compute[74788]: FIRMWARE:
Nov 08 15:22:51 user nova-compute[74788]: No targets found.
Nov 08 15:22:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:22:51 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:22:51 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2752fde6-fec6-4320-b360-c157c4f35e93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31bb076-0f60-4ad8-995d-6ad25a07f209]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:22:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf (non-flash)
Nov 08 15:22:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758488940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ac5e5-a823-48cd-b828-84628385d589]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89f93e-74f0-4b16-bc25-bf34fa0e1dbe]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:22:51 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Deleted allocations for instance 2d882e66-2691-4939-9e9e-eec036979cd6
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1a0a0-7812-4688-96a9-e83b939ad1b9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37ef72-01d7-475a-bd9a-a6897d0bc95e]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c77e5a5-2c7b-4e64-bb1e-decf532b6172 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "2d882e66-2691-4939-9e9e-eec036979cd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7081b-d3f9-4358-a7fd-ed504d9a8514]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa8e643-532c-47b5-a594-6fc7c382215d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260]
Nov 08 15:22:51 user nova-compute[74788]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf, portal: 172.16.0.220,3260] successful.
Nov 08 15:22:51 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217040bd-423d-46a4-a6d8-c7e2a762afcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[289478a6-e24c-4698-b16a-74230c7bdebb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== disconnect_volume: return (417ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] Acquiring lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] Lock "2d882e66-2691-4939-9e9e-eec036979cd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] No waiting events found dispatching network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:51 user nova-compute[74788]: WARNING nova.compute.manager [req-1c06ce15-a568-4c90-925d-669c780fa0a4 req-e0ad03d4-9c27-4f7d-8b4d-11f172579972 service nova] [instance: 2d882e66-2691-4939-9e9e-eec036979cd6] Received unexpected event network-vif-plugged-3634a657-2985-4d87-b144-2a2145173757 for instance with vm_state deleted and task_state None.
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:51 user nova-compute[74788]: INFO nova.compute.manager [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Terminating instance
Nov 08 15:22:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Instance destroyed successfully.
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.objects.instance [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'resources' on Instance uuid 16d4b216-2642-4df7-b0dd-a8b7da36b88e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70773012',display_name='tempest-AttachVolumeTestJSON-server-70773012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70773012',id=2,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUROTTjgnfSkgE9g+zplnV9sQRfOMYtqFJy0wS8ekcjpnFH7+VJO7xJSZovI5uajolkCM21ovP4uuJ7F3yMxX8XPEizb9EjEpryaKbTxVlAv5bOaKwDTs63FZ+xvgLsfA==',key_name='tempest-keypair-228790940',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:11:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-somrq6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=16d4b216-2642-4df7-b0dd-a8b7da36b88e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "64118033-36fd-4778-a574-53d4a32ec9c1", "address": "fa:16:3e:35:3e:45", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64118033-36", "ovs_interfaceid": "64118033-36fd-4778-a574-53d4a32ec9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG os_vif [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64118033-36, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d92c25ca-5cc0-419c-816c-78f3a41640d3) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: INFO os_vif [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3e:45,bridge_name='br-int',has_traffic_filtering=True,id=64118033-36fd-4778-a574-53d4a32ec9c1,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64118033-36')
Nov 08 15:22:52 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Deleting instance files /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e_del
Nov 08 15:22:52 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Deletion of /opt/stack/data/nova/instances/16d4b216-2642-4df7-b0dd-a8b7da36b88e_del complete
Nov 08 15:22:52 user nova-compute[74788]: INFO nova.compute.manager [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 08 15:22:52 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG nova.objects.instance [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'flavor' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47afcb6b-14dd-4935-bdb0-c591ce7ade94 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.335s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:53 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Took 0.84 seconds to deallocate network for instance.
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-1bfa9096-1240-4069-b88e-1f8305a1bbc8 req-95275f27-1142-4c15-bd6d-5ac43142687e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-deleted-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:53 user nova-compute[74788]: INFO nova.compute.manager [req-1bfa9096-1240-4069-b88e-1f8305a1bbc8 req-95275f27-1142-4c15-bd6d-5ac43142687e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Neutron deleted interface 64118033-36fd-4778-a574-53d4a32ec9c1; detaching it from the instance and deleting it from the info cache
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-1bfa9096-1240-4069-b88e-1f8305a1bbc8 req-95275f27-1142-4c15-bd6d-5ac43142687e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-1bfa9096-1240-4069-b88e-1f8305a1bbc8 req-95275f27-1142-4c15-bd6d-5ac43142687e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Detach interface failed, port_id=64118033-36fd-4778-a574-53d4a32ec9c1, reason: Instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:53 user nova-compute[74788]: WARNING nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-unplugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state deleted and task_state None.
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Acquiring lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] No waiting events found dispatching network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:22:53 user nova-compute[74788]: WARNING nova.compute.manager [req-b42cd47c-d623-492a-ad63-5edf80a1c691 req-47e549e4-4461-4dc6-8a3e-447c9d55898e service nova] [instance: 16d4b216-2642-4df7-b0dd-a8b7da36b88e] Received unexpected event network-vif-plugged-64118033-36fd-4778-a574-53d4a32ec9c1 for instance with vm_state deleted and task_state None.
Nov 08 15:22:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:53 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Deleted allocations for instance 16d4b216-2642-4df7-b0dd-a8b7da36b88e
Nov 08 15:22:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-67d64629-f777-45b0-84f5-f039e3ce67d6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "16d4b216-2642-4df7-b0dd-a8b7da36b88e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:22:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:22:59 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:22:59 user nova-compute[74788]: INFO nova.compute.claims [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Claim successful on node user
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:23:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.policy [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30bfaf63a8bf4172b0a72ee8536a76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c097c366f91c496e9f5a4cfaff0e14c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:23:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Creating image(s)
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.249s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk 1073741824" returned: 0 in 0.057s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.229s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Successfully created port: 451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Cannot resize image /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Ensure instance console log exists: /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Successfully updated port: 451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-changed-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Refreshing instance network info cache due to event network-changed-451bdddb-f4ef-4f81-8c6f-1a087a7cf116. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] Acquiring lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating instance_info_cache with network_info: [{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance network_info: |[{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] Acquired lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Refreshing network info cache for port 451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start _get_guest_xml network_info=[{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-tempest.common.compute-instance-1217183129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:23:02 user nova-compute[74788]:   <uuid>2a33da20-7af4-4d6c-8cba-94cf3986245c</uuid>
Nov 08 15:23:02 user nova-compute[74788]:   <name>instance-00000017</name>
Nov 08 15:23:02 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:23:02 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:23:02 user nova-compute[74788]:   <metadata>
Nov 08 15:23:02 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:23:02 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:name>tempest-tempest.common.compute-instance-1217183129</nova:name>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:23:02</nova:creationTime>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:23:02 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:23:02 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:owner>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:user uuid="30bfaf63a8bf4172b0a72ee8536a76b2">tempest-ServerActionsTestOtherA-27641552-project-member</nova:user>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:project uuid="c097c366f91c496e9f5a4cfaff0e14c6">tempest-ServerActionsTestOtherA-27641552</nova:project>
Nov 08 15:23:02 user nova-compute[74788]:       </nova:owner>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:23:02 user nova-compute[74788]:       <nova:ports>
Nov 08 15:23:02 user nova-compute[74788]:         <nova:port uuid="451bdddb-f4ef-4f81-8c6f-1a087a7cf116">
Nov 08 15:23:02 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:23:02 user nova-compute[74788]:         </nova:port>
Nov 08 15:23:02 user nova-compute[74788]:       </nova:ports>
Nov 08 15:23:02 user nova-compute[74788]:     </nova:instance>
Nov 08 15:23:02 user nova-compute[74788]:   </metadata>
Nov 08 15:23:02 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:23:02 user nova-compute[74788]:     <system>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="serial">2a33da20-7af4-4d6c-8cba-94cf3986245c</entry>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="uuid">2a33da20-7af4-4d6c-8cba-94cf3986245c</entry>
Nov 08 15:23:02 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:23:02 user nova-compute[74788]:     </system>
Nov 08 15:23:02 user nova-compute[74788]:   </sysinfo>
Nov 08 15:23:02 user nova-compute[74788]:   <os>
Nov 08 15:23:02 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:23:02 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:23:02 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:23:02 user nova-compute[74788]:   </os>
Nov 08 15:23:02 user nova-compute[74788]:   <features>
Nov 08 15:23:02 user nova-compute[74788]:     <acpi/>
Nov 08 15:23:02 user nova-compute[74788]:     <apic/>
Nov 08 15:23:02 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:23:02 user nova-compute[74788]:   </features>
Nov 08 15:23:02 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:23:02 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:23:02 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:23:02 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:23:02 user nova-compute[74788]:   </clock>
Nov 08 15:23:02 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:23:02 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:23:02 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:23:02 user nova-compute[74788]:   </cpu>
Nov 08 15:23:02 user nova-compute[74788]:   <devices>
Nov 08 15:23:02 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:23:02 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:23:02 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk"/>
Nov 08 15:23:02 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:23:02 user nova-compute[74788]:     </disk>
Nov 08 15:23:02 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:23:02 user nova-compute[74788]:       <mac address="fa:16:3e:24:b6:f0"/>
Nov 08 15:23:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:02 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:23:02 user nova-compute[74788]:       <target dev="tap451bdddb-f4"/>
Nov 08 15:23:02 user nova-compute[74788]:     </interface>
Nov 08 15:23:02 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:23:02 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/console.log" append="off"/>
Nov 08 15:23:02 user nova-compute[74788]:     </serial>
Nov 08 15:23:02 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:23:02 user nova-compute[74788]:     <video>
Nov 08 15:23:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:02 user nova-compute[74788]:     </video>
Nov 08 15:23:02 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:23:02 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:23:02 user nova-compute[74788]:     </rng>
Nov 08 15:23:02 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:23:02 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:23:02 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:23:02 user nova-compute[74788]:     </memballoon>
Nov 08 15:23:02 user nova-compute[74788]:   </devices>
Nov 08 15:23:02 user nova-compute[74788]: </domain>
Nov 08 15:23:02 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-tempest.common.compute-instance-1217183129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG os_vif [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '014de124-2867-52e6-a880-5861ce532c33', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451bdddb-f4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap451bdddb-f4, col_values=(('qos', UUID('7f0dcd5f-0c1f-4254-b268-b4cd6f27d1f6')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap451bdddb-f4, col_values=(('external_ids', {'iface-id': '451bdddb-f4ef-4f81-8c6f-1a087a7cf116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:b6:f0', 'vm-uuid': '2a33da20-7af4-4d6c-8cba-94cf3986245c'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:02 user nova-compute[74788]: INFO os_vif [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4')
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:24:b6:f0, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updated VIF entry in instance network info cache for port 451bdddb-f4ef-4f81-8c6f-1a087a7cf116. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating instance_info_cache with network_info: [{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-27d88c88-459f-4d47-93c1-b41ea0c4d95d req-88fcfb90-c2c7-41d2-8eaa-5af5fee85fb3 service nova] Releasing lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:04 user nova-compute[74788]: WARNING nova.compute.manager [req-13a34203-57be-4cc0-882f-1330656c7c8a req-104027d9-f0aa-49b5-9d9b-444adb5bc38c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state building and task_state spawning.
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:23:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance spawned successfully.
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:06 user nova-compute[74788]: WARNING nova.compute.manager [req-c1a84375-d6d8-4025-bc31-7b8ff49d345e req-9a0d3669-607a-4b34-bb3a-dd61e84d68d8 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state building and task_state spawning.
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:06 user nova-compute[74788]: INFO nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 08 15:23:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:23:06 user nova-compute[74788]: INFO nova.compute.manager [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Took 7.12 seconds to build instance.
Nov 08 15:23:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d87cc4ab-322c-469b-a3c4-d363880d408a tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.229s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing instance network info cache due to event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] Acquiring lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] Acquired lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updated VIF entry in instance network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613b93fd-1b10-4ac7-a826-e4f0a81a4e00 req-d93f4321-8f92-4005-a3ca-45243887988d service nova] Releasing lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:27 user nova-compute[74788]: INFO nova.compute.manager [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Attaching volume 4ca9b03e-80b8-48b8-bede-33894903241b to /dev/vdb
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.utils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eedc5c4-d9f5-4244-9cc1-e8c858006517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd99b8-0cbb-4e56-aeea-bde98d33fc25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31d10b6-d981-4599-b019-a2dc94f83625]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa855e56-fece-4e5b-8e42-85ffeb3b5ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:23:27 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:23:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44db69a-de98-46cc-ae46-67d2cb8660ad]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG os_brick.utils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating existing volume attachment record: 3394ccef-14db-49da-968f-26491dc57ad7 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:33 user nova-compute[74788]: INFO nova.compute.manager [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Terminating instance
Nov 08 15:23:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-1161d078-417b-496e-848b-a02621cc7086 req-ad731fc4-e61b-4afa-b70e-0fe1b26d6176 service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-unplugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:23:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Instance destroyed successfully.
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'resources' on Instance uuid bf5695e6-02aa-4093-a556-a62e367b5925 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-714106190',display_name='tempest-TestMinimumBasicScenario-server-714106190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-714106190',id=13,image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXOM1UC58eWzofOeylAvYSrykgT/Sj/NJFQOptnjM8T+1lDFTv6mlThj0O5ARNN4jFofytP6tvmpU7umF7WJmHCp26y1ekXjAs/Fq37DohRV5ua0J/GTv5dBeCeHxt96w==',key_name='tempest-TestMinimumBasicScenario-2043720478',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-padlyy91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01e1bbd8-d575-4619-9315-afa82edb0308',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:20:47Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=bf5695e6-02aa-4093-a556-a62e367b5925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "address": "fa:16:3e:17:6f:8c", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcf6e7bf-d4", "ovs_interfaceid": "dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG os_vif [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcf6e7bf-d4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bd4bc12-a51b-4f79-bd02-a289d89ba48d) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:34 user nova-compute[74788]: INFO os_vif [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:6f:8c,bridge_name='br-int',has_traffic_filtering=True,id=dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcf6e7bf-d4')
Nov 08 15:23:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Deleting instance files /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925_del
Nov 08 15:23:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Deletion of /opt/stack/data/nova/instances/bf5695e6-02aa-4093-a556-a62e367b5925_del complete
Nov 08 15:23:34 user nova-compute[74788]: INFO nova.compute.manager [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 15:23:34 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:23:34 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:23:35 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:35 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Took 1.18 seconds to deallocate network for instance.
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] Acquiring lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] Lock "bf5695e6-02aa-4093-a556-a62e367b5925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] No waiting events found dispatching network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:36 user nova-compute[74788]: WARNING nova.compute.manager [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received unexpected event network-vif-plugged-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d for instance with vm_state deleted and task_state None.
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-963b2765-503b-489b-8706-d2cd5589f1fa req-695df3e7-1e1a-405c-9050-5a3ae55924ba service nova] [instance: bf5695e6-02aa-4093-a556-a62e367b5925] Received event network-vif-deleted-dcf6e7bf-d40f-4bb8-92fd-f95b286cdf7d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:36 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Deleted allocations for instance bf5695e6-02aa-4093-a556-a62e367b5925
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0e4878dd-30af-4639-8c2d-1771bffcadf6 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "bf5695e6-02aa-4093-a556-a62e367b5925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.626s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:37 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:40 user nova-compute[74788]: INFO nova.compute.manager [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Unshelving
Nov 08 15:23:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:23:41 user nova-compute[74788]: INFO nova.compute.claims [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Claim successful on node user
Nov 08 15:23:41 user nova-compute[74788]: INFO nova.virt.block_device [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Booting with volume 13dcbb24-579b-4cb4-9603-392501381c89 at /dev/vdc
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.utils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=25.474761962890625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fee84-6488-4258-9b02-2953ff0621bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4737b60-f1b2-4844-b84a-dc7553dcd218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c24bae-c4b0-4fde-9407-f85ceabcb89b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a0e57-113e-40bc-a81c-98fcda71f198]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:23:41 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f421d9-3150-4365-9237-11ea500a2d8e]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG os_brick.utils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating existing volume attachment record: e81de1ef-8181-4cb2-af5b-4c0c0f6264db {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.884s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.393s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:23:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:23:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f09be848-e7e9-4963-a465-28ef011b20b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.policy [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '471971c5b22e403cb5b2f573b54f8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599044705f5d49f19ef319ebc7b8f04c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:23:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Creating image(s)
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "/opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "/opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "/opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.263s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk 1073741824" returned: 0 in 0.073s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Successfully created port: c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Cannot resize image /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Ensure instance console log exists: /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Successfully updated port: c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquired lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-changed-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Refreshing instance network info cache due to event network-changed-c3f32256-1752-4719-b0df-d3e4c852cbf1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] Acquiring lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Updating instance_info_cache with network_info: [{"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Releasing lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Instance network_info: |[{"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] Acquired lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Refreshing network info cache for port c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Start _get_guest_xml network_info=[{"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:23:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-128467844',display_name='tempest-VolumesActionsTest-instance-128467844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-128467844',id=24,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-pi22kx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:42Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=f09be848-e7e9-4963-a465-28ef011b20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lazy-loading 'pci_devices' on Instance uuid f09be848-e7e9-4963-a465-28ef011b20b3 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:23:44 user nova-compute[74788]:   <uuid>f09be848-e7e9-4963-a465-28ef011b20b3</uuid>
Nov 08 15:23:44 user nova-compute[74788]:   <name>instance-00000018</name>
Nov 08 15:23:44 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:23:44 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:23:44 user nova-compute[74788]:   <metadata>
Nov 08 15:23:44 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:23:44 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:name>tempest-VolumesActionsTest-instance-128467844</nova:name>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:23:44</nova:creationTime>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:23:44 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:23:44 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:owner>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:user uuid="471971c5b22e403cb5b2f573b54f8a3d">tempest-VolumesActionsTest-736158225-project-member</nova:user>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:project uuid="599044705f5d49f19ef319ebc7b8f04c">tempest-VolumesActionsTest-736158225</nova:project>
Nov 08 15:23:44 user nova-compute[74788]:       </nova:owner>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:23:44 user nova-compute[74788]:       <nova:ports>
Nov 08 15:23:44 user nova-compute[74788]:         <nova:port uuid="c3f32256-1752-4719-b0df-d3e4c852cbf1">
Nov 08 15:23:44 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 15:23:44 user nova-compute[74788]:         </nova:port>
Nov 08 15:23:44 user nova-compute[74788]:       </nova:ports>
Nov 08 15:23:44 user nova-compute[74788]:     </nova:instance>
Nov 08 15:23:44 user nova-compute[74788]:   </metadata>
Nov 08 15:23:44 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:23:44 user nova-compute[74788]:     <system>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="serial">f09be848-e7e9-4963-a465-28ef011b20b3</entry>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="uuid">f09be848-e7e9-4963-a465-28ef011b20b3</entry>
Nov 08 15:23:44 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:23:44 user nova-compute[74788]:     </system>
Nov 08 15:23:44 user nova-compute[74788]:   </sysinfo>
Nov 08 15:23:44 user nova-compute[74788]:   <os>
Nov 08 15:23:44 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:23:44 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:23:44 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:23:44 user nova-compute[74788]:   </os>
Nov 08 15:23:44 user nova-compute[74788]:   <features>
Nov 08 15:23:44 user nova-compute[74788]:     <acpi/>
Nov 08 15:23:44 user nova-compute[74788]:     <apic/>
Nov 08 15:23:44 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:23:44 user nova-compute[74788]:   </features>
Nov 08 15:23:44 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:23:44 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:23:44 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:23:44 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:23:44 user nova-compute[74788]:   </clock>
Nov 08 15:23:44 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:23:44 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:23:44 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:23:44 user nova-compute[74788]:   </cpu>
Nov 08 15:23:44 user nova-compute[74788]:   <devices>
Nov 08 15:23:44 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:23:44 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:23:44 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk"/>
Nov 08 15:23:44 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:23:44 user nova-compute[74788]:     </disk>
Nov 08 15:23:44 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:23:44 user nova-compute[74788]:       <mac address="fa:16:3e:10:7d:c2"/>
Nov 08 15:23:44 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:44 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:23:44 user nova-compute[74788]:       <target dev="tapc3f32256-17"/>
Nov 08 15:23:44 user nova-compute[74788]:     </interface>
Nov 08 15:23:44 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:23:44 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/console.log" append="off"/>
Nov 08 15:23:44 user nova-compute[74788]:     </serial>
Nov 08 15:23:44 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:23:44 user nova-compute[74788]:     <video>
Nov 08 15:23:44 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:44 user nova-compute[74788]:     </video>
Nov 08 15:23:44 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:23:44 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:23:44 user nova-compute[74788]:     </rng>
Nov 08 15:23:44 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:23:44 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:23:44 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:23:44 user nova-compute[74788]:     </memballoon>
Nov 08 15:23:44 user nova-compute[74788]:   </devices>
Nov 08 15:23:44 user nova-compute[74788]: </domain>
Nov 08 15:23:44 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-128467844',display_name='tempest-VolumesActionsTest-instance-128467844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-128467844',id=24,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-pi22kx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:42Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=f09be848-e7e9-4963-a465-28ef011b20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG os_vif [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f9e3013-1eac-5f78-b7da-969b43e241d3', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f32256-17, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3f32256-17, col_values=(('qos', UUID('501153fd-09fb-4daa-9885-12bb6b9d8f98')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3f32256-17, col_values=(('external_ids', {'iface-id': 'c3f32256-1752-4719-b0df-d3e4c852cbf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:7d:c2', 'vm-uuid': 'f09be848-e7e9-4963-a465-28ef011b20b3'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:44 user nova-compute[74788]: INFO os_vif [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17')
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] No VIF found with MAC fa:16:3e:10:7d:c2, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Updated VIF entry in instance network info cache for port c3f32256-1752-4719-b0df-d3e4c852cbf1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Updating instance_info_cache with network_info: [{"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5ca423bf-ada0-4bad-9d48-048faa9b8ac6 req-6c45b231-0eed-4844-abd6-3f87c7c7e2d0 service nova] Releasing lock "refresh_cache-f09be848-e7e9-4963-a465-28ef011b20b3" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:45 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] No waiting events found dispatching network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:46 user nova-compute[74788]: WARNING nova.compute.manager [req-0b1ff8b9-1159-4f6a-881c-42d3ce667faa req-c2510e79-4f01-472d-8bab-e45d9a3bbae6 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received unexpected event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 for instance with vm_state building and task_state spawning.
Nov 08 15:23:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:46 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:23:46 user nova-compute[74788]: INFO nova.compute.claims [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Claim successful on node user
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:23:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.policy [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '649a41ab82754c269c03606c18428b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7984a5e14b104fdbbe50c0171702b765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:23:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Creating image(s)
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "/opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "/opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "/opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk 1073741824" returned: 0 in 0.061s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] No waiting events found dispatching network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:48 user nova-compute[74788]: WARNING nova.compute.manager [req-687932a4-4132-486d-bf05-50a2d24b986a req-a84c26ac-f104-4144-abdd-1fa9d0d6660c service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received unexpected event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 for instance with vm_state building and task_state spawning.
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Successfully created port: 9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:23:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Instance spawned successfully.
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Cannot resize image /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Ensure instance console log exists: /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:48 user nova-compute[74788]: INFO nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 08 15:23:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:23:48 user nova-compute[74788]: INFO nova.compute.manager [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Took 7.69 seconds to build instance.
Nov 08 15:23:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d9e68427-9e8a-496f-aba0-c10f8460b067 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.797s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Successfully updated port: 9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquired lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-changed-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Refreshing instance network info cache due to event network-changed-9942c8e9-6b88-49e6-878e-7d4d0b0db18f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] Acquiring lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating instance_info_cache with network_info: [{"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Releasing lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Instance network_info: |[{"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] Acquired lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Refreshing network info cache for port 9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Start _get_guest_xml network_info=[{"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:23:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-876919619',display_name='tempest-AttachVolumeTestJSON-server-876919619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-876919619',id=25,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD9reh/BHnCemFz65SIHPquEQDrk0bx1TKLZcsO2x0uj/t86CpK/o5H6Drn+KCf0C/Bv0sObPJRxd84bCaJLQA95UDRGjk91uhtko7gx/H8pyzciVzRS5YPx6nTfzYS9w==',key_name='tempest-keypair-1685087599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-vsf0ele7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=04fede4a-9cd5-4386-a083-b25334ebbd03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'pci_devices' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:23:49 user nova-compute[74788]:   <uuid>04fede4a-9cd5-4386-a083-b25334ebbd03</uuid>
Nov 08 15:23:49 user nova-compute[74788]:   <name>instance-00000019</name>
Nov 08 15:23:49 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:23:49 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:23:49 user nova-compute[74788]:   <metadata>
Nov 08 15:23:49 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:23:49 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeTestJSON-server-876919619</nova:name>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:23:49</nova:creationTime>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:23:49 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:23:49 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:owner>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:user uuid="649a41ab82754c269c03606c18428b86">tempest-AttachVolumeTestJSON-1302335670-project-member</nova:user>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:project uuid="7984a5e14b104fdbbe50c0171702b765">tempest-AttachVolumeTestJSON-1302335670</nova:project>
Nov 08 15:23:49 user nova-compute[74788]:       </nova:owner>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:23:49 user nova-compute[74788]:       <nova:ports>
Nov 08 15:23:49 user nova-compute[74788]:         <nova:port uuid="9942c8e9-6b88-49e6-878e-7d4d0b0db18f">
Nov 08 15:23:49 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:23:49 user nova-compute[74788]:         </nova:port>
Nov 08 15:23:49 user nova-compute[74788]:       </nova:ports>
Nov 08 15:23:49 user nova-compute[74788]:     </nova:instance>
Nov 08 15:23:49 user nova-compute[74788]:   </metadata>
Nov 08 15:23:49 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:23:49 user nova-compute[74788]:     <system>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="serial">04fede4a-9cd5-4386-a083-b25334ebbd03</entry>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="uuid">04fede4a-9cd5-4386-a083-b25334ebbd03</entry>
Nov 08 15:23:49 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:23:49 user nova-compute[74788]:     </system>
Nov 08 15:23:49 user nova-compute[74788]:   </sysinfo>
Nov 08 15:23:49 user nova-compute[74788]:   <os>
Nov 08 15:23:49 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:23:49 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:23:49 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:23:49 user nova-compute[74788]:   </os>
Nov 08 15:23:49 user nova-compute[74788]:   <features>
Nov 08 15:23:49 user nova-compute[74788]:     <acpi/>
Nov 08 15:23:49 user nova-compute[74788]:     <apic/>
Nov 08 15:23:49 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:23:49 user nova-compute[74788]:   </features>
Nov 08 15:23:49 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:23:49 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:23:49 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:23:49 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:23:49 user nova-compute[74788]:   </clock>
Nov 08 15:23:49 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:23:49 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:23:49 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:23:49 user nova-compute[74788]:   </cpu>
Nov 08 15:23:49 user nova-compute[74788]:   <devices>
Nov 08 15:23:49 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:23:49 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:23:49 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk"/>
Nov 08 15:23:49 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:23:49 user nova-compute[74788]:     </disk>
Nov 08 15:23:49 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:23:49 user nova-compute[74788]:       <mac address="fa:16:3e:fc:6b:fd"/>
Nov 08 15:23:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:49 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:23:49 user nova-compute[74788]:       <target dev="tap9942c8e9-6b"/>
Nov 08 15:23:49 user nova-compute[74788]:     </interface>
Nov 08 15:23:49 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:23:49 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/console.log" append="off"/>
Nov 08 15:23:49 user nova-compute[74788]:     </serial>
Nov 08 15:23:49 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:23:49 user nova-compute[74788]:     <video>
Nov 08 15:23:49 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:23:49 user nova-compute[74788]:     </video>
Nov 08 15:23:49 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:23:49 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:23:49 user nova-compute[74788]:     </rng>
Nov 08 15:23:49 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:23:49 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:23:49 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:23:49 user nova-compute[74788]:     </memballoon>
Nov 08 15:23:49 user nova-compute[74788]:   </devices>
Nov 08 15:23:49 user nova-compute[74788]: </domain>
Nov 08 15:23:49 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-876919619',display_name='tempest-AttachVolumeTestJSON-server-876919619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-876919619',id=25,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD9reh/BHnCemFz65SIHPquEQDrk0bx1TKLZcsO2x0uj/t86CpK/o5H6Drn+KCf0C/Bv0sObPJRxd84bCaJLQA95UDRGjk91uhtko7gx/H8pyzciVzRS5YPx6nTfzYS9w==',key_name='tempest-keypair-1685087599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-vsf0ele7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=04fede4a-9cd5-4386-a083-b25334ebbd03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG os_vif [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f241dcc9-e637-5e13-b9e8-87ee652989a8', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9942c8e9-6b, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9942c8e9-6b, col_values=(('qos', UUID('cdd155a8-9332-4910-9e3d-28fb142d1230')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9942c8e9-6b, col_values=(('external_ids', {'iface-id': '9942c8e9-6b88-49e6-878e-7d4d0b0db18f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:6b:fd', 'vm-uuid': '04fede4a-9cd5-4386-a083-b25334ebbd03'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:49 user nova-compute[74788]: INFO os_vif [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b')
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:23:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No VIF found with MAC fa:16:3e:fc:6b:fd, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:23:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updated VIF entry in instance network info cache for port 9942c8e9-6b88-49e6-878e-7d4d0b0db18f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:23:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating instance_info_cache with network_info: [{"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:23:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ad54564c-376f-4ca2-a9f0-802945f2f4a4 req-e9d4e9cb-4de9-4851-b6ce-603f51f43fe5 service nova] Releasing lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] No waiting events found dispatching network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:51 user nova-compute[74788]: WARNING nova.compute.manager [req-b9363baf-319e-4369-89b0-cb16a2eea0cd req-9b44047d-67dc-46f7-9c15-624e8383074f service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received unexpected event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f for instance with vm_state building and task_state spawning.
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOFQSrEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:23:52 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:23:52 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:23:52 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac55a07-b961-4651-a9ab-f7df3ed41ca9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:23:52 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd104d2-b684-4016-b6f9-c42d7046a17d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b] added
Nov 08 15:23:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[145cfeca-af5b-46bc-8311-b397961a43e9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8e102-f0dd-42e0-9698-39b3bb45879a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOFQSrEe {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOFQSrEe" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ce618-12ab-4597-8062-26c277da291f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOFQSrEe'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a5dcfc-9665-44d5-91a9-c3723ab4b233]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d2002e-c04f-4cac-806b-f80c4d3feacf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:23:52 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:23:52 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:23:52 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:23:52 user nova-compute[74788]: 
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[971fa04a-86a8-4802-90d0-e1f4d000b950]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260]
Nov 08 15:23:52 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260] successful.
Nov 08 15:23:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1ae97-a2c3-44bb-9244-5e254e29506e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8dc678-7420-43a2-9636-6001abc84c26]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)
Nov 08 15:23:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)
Nov 08 15:23:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0b4270-c931-4b6a-9a82-56573aa38f2d]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:23:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] No waiting events found dispatching network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:23:53 user nova-compute[74788]: WARNING nova.compute.manager [req-3bab83e9-7fc3-4f0f-945b-6b782f25c1aa req-87536f11-d195-4fe1-99a8-3bec3d2650da service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received unexpected event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f for instance with vm_state building and task_state spawning.
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:23:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Instance spawned successfully.
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOFQSrEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26530303438383363', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303438383363', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:23:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:23:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:23:53 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:23:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:23:53 user nova-compute[74788]:   <serial>4ca9b03e-80b8-48b8-bede-33894903241b</serial>
Nov 08 15:23:53 user nova-compute[74788]: </disk>
Nov 08 15:23:53 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:23:54 user nova-compute[74788]: INFO nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 08 15:23:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:23:54 user nova-compute[74788]: INFO nova.compute.manager [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Took 7.44 seconds to build instance.
Nov 08 15:23:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e2f74dee-236a-4f78-99c4-d7306373cde6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.557s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No VIF found with MAC fa:16:3e:f1:7d:51, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:23:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4bd8ec72-c3b1-4341-9f7b-2bd577cd878e tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.923s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:23:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:23:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:23:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:23:57 user nova-compute[74788]: INFO nova.compute.manager [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Detaching volume 4ca9b03e-80b8-48b8-bede-33894903241b
Nov 08 15:23:58 user nova-compute[74788]: INFO nova.virt.block_device [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Attempting to driver detach volume 4ca9b03e-80b8-48b8-bede-33894903241b from mountpoint /dev/vdb
Nov 08 15:23:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Attempting to detach device vdb from instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:23:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:23:58 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:23:58 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:23:58 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:23:58 user nova-compute[74788]:   <serial>4ca9b03e-80b8-48b8-bede-33894903241b</serial>
Nov 08 15:23:58 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:23:58 user nova-compute[74788]: </disk>
Nov 08 15:23:58 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:23:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully detached device vdb from instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 from the persistent domain config.
Nov 08 15:23:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:23:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:23:58 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:23:58 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:23:58 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:23:58 user nova-compute[74788]:   <serial>4ca9b03e-80b8-48b8-bede-33894903241b</serial>
Nov 08 15:23:58 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:23:58 user nova-compute[74788]: </disk>
Nov 08 15:23:58 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:23:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:23:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:24:06 user nova-compute[74788]: INFO nova.compute.claims [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Claim successful on node user
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:24:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:24:06 user nova-compute[74788]: DEBUG nova.policy [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d0153aeff0b48cab43dd5e5efdf8ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97254dd86e849089302f68dac57dd62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:24:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Creating image(s)
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "/opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "/opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "/opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk 1073741824" returned: 0 in 0.057s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.267s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Successfully created port: 9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Cannot resize image /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Ensure instance console log exists: /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Successfully updated port: 9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquired lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-changed-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Refreshing instance network info cache due to event network-changed-9ed2f77c-f219-4816-a9a6-2f680fd92de9. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] Acquiring lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Updating instance_info_cache with network_info: [{"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Releasing lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Instance network_info: |[{"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] Acquired lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Refreshing network info cache for port 9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Start _get_guest_xml network_info=[{"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:24:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1632680922',display_name='tempest-VolumesNegativeTest-instance-1632680922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1632680922',id=26,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a97254dd86e849089302f68dac57dd62',ramdisk_id='',reservation_id='r-b31saqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-478478059',owner_user_name='tempest-VolumesNegativeTest-478478059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:24:07Z,user_data=None,user_id='8d0153aeff0b48cab43dd5e5efdf8ade',uuid=996a41db-79b5-4375-82a6-153b3cbd5cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converting VIF {"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lazy-loading 'pci_devices' on Instance uuid 996a41db-79b5-4375-82a6-153b3cbd5cf1 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:24:09 user nova-compute[74788]:   <uuid>996a41db-79b5-4375-82a6-153b3cbd5cf1</uuid>
Nov 08 15:24:09 user nova-compute[74788]:   <name>instance-0000001a</name>
Nov 08 15:24:09 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:24:09 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:24:09 user nova-compute[74788]:   <metadata>
Nov 08 15:24:09 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:24:09 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:name>tempest-VolumesNegativeTest-instance-1632680922</nova:name>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:24:09</nova:creationTime>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:24:09 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:24:09 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:owner>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:user uuid="8d0153aeff0b48cab43dd5e5efdf8ade">tempest-VolumesNegativeTest-478478059-project-member</nova:user>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:project uuid="a97254dd86e849089302f68dac57dd62">tempest-VolumesNegativeTest-478478059</nova:project>
Nov 08 15:24:09 user nova-compute[74788]:       </nova:owner>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:24:09 user nova-compute[74788]:       <nova:ports>
Nov 08 15:24:09 user nova-compute[74788]:         <nova:port uuid="9ed2f77c-f219-4816-a9a6-2f680fd92de9">
Nov 08 15:24:09 user nova-compute[74788]:           <nova:ip type="fixed" address="192.168.233.132" ipVersion="4"/>
Nov 08 15:24:09 user nova-compute[74788]:         </nova:port>
Nov 08 15:24:09 user nova-compute[74788]:       </nova:ports>
Nov 08 15:24:09 user nova-compute[74788]:     </nova:instance>
Nov 08 15:24:09 user nova-compute[74788]:   </metadata>
Nov 08 15:24:09 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:24:09 user nova-compute[74788]:     <system>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="serial">996a41db-79b5-4375-82a6-153b3cbd5cf1</entry>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="uuid">996a41db-79b5-4375-82a6-153b3cbd5cf1</entry>
Nov 08 15:24:09 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:24:09 user nova-compute[74788]:     </system>
Nov 08 15:24:09 user nova-compute[74788]:   </sysinfo>
Nov 08 15:24:09 user nova-compute[74788]:   <os>
Nov 08 15:24:09 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:24:09 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:24:09 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:24:09 user nova-compute[74788]:   </os>
Nov 08 15:24:09 user nova-compute[74788]:   <features>
Nov 08 15:24:09 user nova-compute[74788]:     <acpi/>
Nov 08 15:24:09 user nova-compute[74788]:     <apic/>
Nov 08 15:24:09 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:24:09 user nova-compute[74788]:   </features>
Nov 08 15:24:09 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:24:09 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:24:09 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:24:09 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:24:09 user nova-compute[74788]:   </clock>
Nov 08 15:24:09 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:24:09 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:24:09 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:24:09 user nova-compute[74788]:   </cpu>
Nov 08 15:24:09 user nova-compute[74788]:   <devices>
Nov 08 15:24:09 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:24:09 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:24:09 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk"/>
Nov 08 15:24:09 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:24:09 user nova-compute[74788]:     </disk>
Nov 08 15:24:09 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:24:09 user nova-compute[74788]:       <mac address="fa:16:3e:d1:4f:38"/>
Nov 08 15:24:09 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:09 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:24:09 user nova-compute[74788]:       <target dev="tap9ed2f77c-f2"/>
Nov 08 15:24:09 user nova-compute[74788]:     </interface>
Nov 08 15:24:09 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:24:09 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/console.log" append="off"/>
Nov 08 15:24:09 user nova-compute[74788]:     </serial>
Nov 08 15:24:09 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:24:09 user nova-compute[74788]:     <video>
Nov 08 15:24:09 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:09 user nova-compute[74788]:     </video>
Nov 08 15:24:09 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:24:09 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:24:09 user nova-compute[74788]:     </rng>
Nov 08 15:24:09 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:24:09 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:24:09 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:24:09 user nova-compute[74788]:     </memballoon>
Nov 08 15:24:09 user nova-compute[74788]:   </devices>
Nov 08 15:24:09 user nova-compute[74788]: </domain>
Nov 08 15:24:09 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1632680922',display_name='tempest-VolumesNegativeTest-instance-1632680922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1632680922',id=26,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a97254dd86e849089302f68dac57dd62',ramdisk_id='',reservation_id='r-b31saqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-478478059',owner_user_name='tempest-VolumesNegativeTest-478478059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:24:07Z,user_data=None,user_id='8d0153aeff0b48cab43dd5e5efdf8ade',uuid=996a41db-79b5-4375-82a6-153b3cbd5cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converting VIF {"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG os_vif [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f4e7288-7c52-5a4d-ad30-5a76b5faa9d3', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ed2f77c-f2, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ed2f77c-f2, col_values=(('qos', UUID('8ed6eddf-f37d-4fc2-a904-7da86d91e992')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ed2f77c-f2, col_values=(('external_ids', {'iface-id': '9ed2f77c-f219-4816-a9a6-2f680fd92de9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:4f:38', 'vm-uuid': '996a41db-79b5-4375-82a6-153b3cbd5cf1'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:09 user nova-compute[74788]: INFO os_vif [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2')
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:24:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] No VIF found with MAC fa:16:3e:d1:4f:38, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Updated VIF entry in instance network info cache for port 9ed2f77c-f219-4816-a9a6-2f680fd92de9. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Updating instance_info_cache with network_info: [{"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cf579c09-9d11-4026-9826-ea22c80e8f5e req-fe66b60d-e817-4104-aab7-ab00c4569e65 service nova] Releasing lock "refresh_cache-996a41db-79b5-4375-82a6-153b3cbd5cf1" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:10 user nova-compute[74788]: WARNING nova.compute.manager [req-343bc62f-d32f-43d7-bc34-5be1e87bc238 req-b6c4cf1b-15ca-4dab-9f9e-42a912ecd473 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state building and task_state spawning.
Nov 08 15:24:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:13 user nova-compute[74788]: WARNING nova.compute.manager [req-7d48e2af-a94f-4b4e-a77a-777e8307d087 req-33994edf-8604-47a1-b0ad-7d92a21959a6 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state building and task_state spawning.
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:24:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Instance spawned successfully.
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:13 user nova-compute[74788]: INFO nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 08 15:24:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:24:13 user nova-compute[74788]: INFO nova.compute.manager [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Took 7.08 seconds to build instance.
Nov 08 15:24:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e18859f0-1053-4adf-8139-4035b4956219 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:18 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 is timed out.
Nov 08 15:24:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully detached device vdb from instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 from the live domain config.
Nov 08 15:24:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOFQSrEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:24:18 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5b766-eba5-40c6-acc7-7f462b12adc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:24:18 user nova-compute[74788]: No targets found.
Nov 08 15:24:18 user nova-compute[74788]: iSNS:
Nov 08 15:24:18 user nova-compute[74788]: No targets found.
Nov 08 15:24:18 user nova-compute[74788]: STATIC:
Nov 08 15:24:18 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b
Nov 08 15:24:18 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:24:18 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:24:18 user nova-compute[74788]: FIRMWARE:
Nov 08 15:24:18 user nova-compute[74788]: No targets found.
Nov 08 15:24:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:24:18 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:24:18 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487103e-5b27-447c-a47c-8f0c4c55b48c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb85e5-1348-4509-a5bc-2241e42bfb49]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)
Nov 08 15:24:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b (non-flash)
Nov 08 15:24:18 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77584e7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00687470-d6e4-40b8-b88c-d796e17e5bab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455c7b2-891a-4d7e-90ce-3f11c0aea419]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90eefff-c757-49cf-8d8b-82e6f168adcf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:24:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e83344-f70f-4447-92a2-6b574fcf64c6]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec859adb-15c3-430c-874a-b3b8b9a817c1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10d43c-3741-4777-a3da-dca5187513f2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260]
Nov 08 15:24:19 user nova-compute[74788]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b, portal: 172.16.0.220,3260] successful.
Nov 08 15:24:19 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ca9b03e-80b8-48b8-bede-33894903241b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d220f72-8ceb-4e36-997e-6427648bd13e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== disconnect_volume: return (335ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_requests' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'numa_topology' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:24:19 user nova-compute[74788]: INFO nova.compute.claims [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Claim successful on node user
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:24:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:19 user nova-compute[74788]: INFO nova.network.neutron [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating port fe1e7383-efd7-4e26-820a-28556fe554c1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1fad552f-a960-4224-af81-054b6b9faf11 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.143s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.compute.manager [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing instance network info cache due to event network-changed-fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] Acquiring lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:24:20 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Creating image(s)
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'trusted_certs' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] Acquired lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.network.neutron [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Refreshing network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG nova.objects.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<751fb539-5e41-405a-af55-40a54d1ce66d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "0f17dc79209f22605154a5440b711c3125b7d36b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "0f17dc79209f22605154a5440b711c3125b7d36b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG nova.virt.images [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] fd54803a-721f-4c2e-89d5-950d32ab5ca0 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.part /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updated VIF entry in instance network info cache for port fe1e7383-efd7-4e26-820a-28556fe554c1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a4ac3c0d-5971-4513-ae8e-f7dd87cd4d15 req-25a76718-c530-4414-9828-f97678435f41 service nova] Releasing lock "refresh_cache-751fb539-5e41-405a-af55-40a54d1ce66d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.part /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.converted" returned: 0 in 0.531s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "0f17dc79209f22605154a5440b711c3125b7d36b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.958s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json" returned: 0 in 0.168s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "0f17dc79209f22605154a5440b711c3125b7d36b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "0f17dc79209f22605154a5440b711c3125b7d36b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b,backing_fmt=raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b,backing_fmt=raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk 1073741824" returned: 0 in 0.048s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "0f17dc79209f22605154a5440b711c3125b7d36b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'migration_context' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG nova.objects.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<751fb539-5e41-405a-af55-40a54d1ce66d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:24:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Rebasing disk image.
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 -F raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 -F raw /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk" returned: 0 in 2.632s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Ensure instance console log exists: /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start _get_guest_xml network_info=[{"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fc669146ecf89cbe80e6ca15e96c65ac',container_format='bare',created_at=2023-11-08T15:21:48Z,direct_url=<?>,disk_format='qcow2',id=fd54803a-721f-4c2e-89d5-950d32ab5ca0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-56075347-shelved',owner='6fac0333dca24d81b8127258c41a3145',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:21:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nobOMkNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '751fb539-5e41-405a-af55-40a54d1ce66d', 'attached_at': '', 'detached_at': '', 'volume_id': '13dcbb24-579b-4cb4-9603-392501381c89', 'serial': '13dcbb24-579b-4cb4-9603-392501381c89'}, 'attachment_id': 'e81de1ef-8181-4cb2-af5b-4c0c0f6264db', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:24:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fc669146ecf89cbe80e6ca15e96c65ac',container_format='bare',created_at=2023-11-08T15:21:48Z,direct_url=<?>,disk_format='qcow2',id=fd54803a-721f-4c2e-89d5-950d32ab5ca0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-56075347-shelved',owner='6fac0333dca24d81b8127258c41a3145',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:21:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.objects.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<751fb539-5e41-405a-af55-40a54d1ce66d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nobOMkNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:24:26 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:24:26 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:24:26 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a9968-c9a0-4a68-a614-a1ce401d244f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:24:26 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60e854-3162-47a2-868b-8454df3d9da6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89] added
Nov 08 15:24:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daaeb28-ddc7-4deb-8965-a721fa0c9a0e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e453e-2628-4338-b380-7a0c730d1579]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nobOMkNj {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nobOMkNj" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3469cc-d057-42b6-857e-7b72bc2634b6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nobOMkNj'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49c736-e62e-46f0-812b-cbd3771e4658]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e1b98-a903-43ac-87eb-be83fb38d0c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:24:26 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:24:26 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:24:26 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:24:26 user nova-compute[74788]: 
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c6340-ae5d-47d6-9d97-adc8b4bf0c0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260]
Nov 08 15:24:26 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260] successful.
Nov 08 15:24:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[14191785-6037-4573-98cb-12e026f277cb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa1ee4c-1f62-4113-8dda-3f6436ec885a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:24:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:24:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fabca2-05ab-4dc0-82dd-04e2c1d293e9]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nobOMkNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26262333830376438', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262333830376438', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='fd54803a-721f-4c2e-89d5-950d32ab5ca0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1161035840',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:21:53.322456',shelved_host='user',shelved_image_id='fd54803a-721f-4c2e-89d5-950d32ab5ca0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_devices' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.objects.base [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<751fb539-5e41-405a-af55-40a54d1ce66d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:24:27 user nova-compute[74788]:   <uuid>751fb539-5e41-405a-af55-40a54d1ce66d</uuid>
Nov 08 15:24:27 user nova-compute[74788]:   <name>instance-00000011</name>
Nov 08 15:24:27 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:24:27 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:24:27 user nova-compute[74788]:   <metadata>
Nov 08 15:24:27 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:24:27 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-56075347</nova:name>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:24:26</nova:creationTime>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:24:27 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:24:27 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:owner>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:user uuid="6455bc0197734cce88c64797bd83fc2b">tempest-AttachVolumeShelveTestJSON-300191316-project-member</nova:user>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:project uuid="6fac0333dca24d81b8127258c41a3145">tempest-AttachVolumeShelveTestJSON-300191316</nova:project>
Nov 08 15:24:27 user nova-compute[74788]:       </nova:owner>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:root type="image" uuid="fd54803a-721f-4c2e-89d5-950d32ab5ca0"/>
Nov 08 15:24:27 user nova-compute[74788]:       <nova:ports>
Nov 08 15:24:27 user nova-compute[74788]:         <nova:port uuid="fe1e7383-efd7-4e26-820a-28556fe554c1">
Nov 08 15:24:27 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:24:27 user nova-compute[74788]:         </nova:port>
Nov 08 15:24:27 user nova-compute[74788]:       </nova:ports>
Nov 08 15:24:27 user nova-compute[74788]:     </nova:instance>
Nov 08 15:24:27 user nova-compute[74788]:   </metadata>
Nov 08 15:24:27 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:24:27 user nova-compute[74788]:     <system>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="serial">751fb539-5e41-405a-af55-40a54d1ce66d</entry>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="uuid">751fb539-5e41-405a-af55-40a54d1ce66d</entry>
Nov 08 15:24:27 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:24:27 user nova-compute[74788]:     </system>
Nov 08 15:24:27 user nova-compute[74788]:   </sysinfo>
Nov 08 15:24:27 user nova-compute[74788]:   <os>
Nov 08 15:24:27 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:24:27 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:24:27 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:24:27 user nova-compute[74788]:   </os>
Nov 08 15:24:27 user nova-compute[74788]:   <features>
Nov 08 15:24:27 user nova-compute[74788]:     <acpi/>
Nov 08 15:24:27 user nova-compute[74788]:     <apic/>
Nov 08 15:24:27 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:24:27 user nova-compute[74788]:   </features>
Nov 08 15:24:27 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:24:27 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:24:27 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:24:27 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:24:27 user nova-compute[74788]:   </clock>
Nov 08 15:24:27 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:24:27 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:24:27 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:24:27 user nova-compute[74788]:   </cpu>
Nov 08 15:24:27 user nova-compute[74788]:   <devices>
Nov 08 15:24:27 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:24:27 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:24:27 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk"/>
Nov 08 15:24:27 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:24:27 user nova-compute[74788]:     </disk>
Nov 08 15:24:27 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:24:27 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:24:27 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:24:27 user nova-compute[74788]:       <target dev="vdc" bus="virtio"/>
Nov 08 15:24:27 user nova-compute[74788]:       <serial>13dcbb24-579b-4cb4-9603-392501381c89</serial>
Nov 08 15:24:27 user nova-compute[74788]:     </disk>
Nov 08 15:24:27 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:24:27 user nova-compute[74788]:       <mac address="fa:16:3e:34:2d:ca"/>
Nov 08 15:24:27 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:27 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:24:27 user nova-compute[74788]:       <target dev="tapfe1e7383-ef"/>
Nov 08 15:24:27 user nova-compute[74788]:     </interface>
Nov 08 15:24:27 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:24:27 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/console.log" append="off"/>
Nov 08 15:24:27 user nova-compute[74788]:     </serial>
Nov 08 15:24:27 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:24:27 user nova-compute[74788]:     <video>
Nov 08 15:24:27 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:27 user nova-compute[74788]:     </video>
Nov 08 15:24:27 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:24:27 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:24:27 user nova-compute[74788]:     </rng>
Nov 08 15:24:27 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:24:27 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:24:27 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:24:27 user nova-compute[74788]:     </memballoon>
Nov 08 15:24:27 user nova-compute[74788]:   </devices>
Nov 08 15:24:27 user nova-compute[74788]: </domain>
Nov 08 15:24:27 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='fd54803a-721f-4c2e-89d5-950d32ab5ca0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1161035840',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:19:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:21:53.322456',shelved_host='user',shelved_image_id='fd54803a-721f-4c2e-89d5-950d32ab5ca0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG os_vif [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdb41e9a-be35-5d42-9166-d88333c43433', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1e7383-ef, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe1e7383-ef, col_values=(('qos', UUID('b774649b-93c1-4a78-b43e-a0efeb808ec9')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe1e7383-ef, col_values=(('external_ids', {'iface-id': 'fe1e7383-efd7-4e26-820a-28556fe554c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:2d:ca', 'vm-uuid': '751fb539-5e41-405a-af55-40a54d1ce66d'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:27 user nova-compute[74788]: INFO os_vif [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef')
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:24:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No VIF found with MAC fa:16:3e:34:2d:ca, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:29 user nova-compute[74788]: WARNING nova.compute.manager [req-837a910d-4fd6-45c4-a9d6-85056efa8d3a req-9878e6f9-28a5-4369-bee7-d752813be1c8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:24:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:24:29 user nova-compute[74788]: INFO nova.compute.claims [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Claim successful on node user
Nov 08 15:24:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:24:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.policy [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c06d28d62994d15b3a91c5d210eea4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f737b11a8d4a88b798295956c0c41f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:24:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Creating image(s)
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "/opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "/opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "/opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG nova.virt.images [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ffcc8f3a-bdd3-4b06-ae94-e9823a77822d was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.part /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Successfully created port: e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.part /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.converted" returned: 0 in 0.353s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:32 user nova-compute[74788]: WARNING nova.compute.manager [req-dc87964b-ff44-4140-af96-137e349c7d8c req-716d3400-4b11-4f76-ae72-1666a879d18b service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.316s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Successfully updated port: e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquired lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3,backing_fmt=raw /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3,backing_fmt=raw /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk 1073741824" returned: 0 in 0.060s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "fa454b1150bce0fe9638163c8b7ee2b1ead021a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:24:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance spawned successfully.
Nov 08 15:24:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 --force-share --output=json" returned: 0 in 0.229s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f314fdf1-1de5-4b9e-a914-49e0cd9d48a7 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 52.077s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Updating instance_info_cache with network_info: [{"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Cannot resize image /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Ensure instance console log exists: /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Releasing lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Instance network_info: |[{"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Start _get_guest_xml network_info=[{"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:24:26Z,direct_url=<?>,disk_format='qcow2',id=ffcc8f3a-bdd3-4b06-ae94-e9823a77822d,min_disk=0,min_ram=0,name='tempest-scenario-img--1964315161',owner='a0f737b11a8d4a88b798295956c0c41f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:24:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': 'ffcc8f3a-bdd3-4b06-ae94-e9823a77822d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:24:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:24:26Z,direct_url=<?>,disk_format='qcow2',id=ffcc8f3a-bdd3-4b06-ae94-e9823a77822d,min_disk=0,min_ram=0,name='tempest-scenario-img--1964315161',owner='a0f737b11a8d4a88b798295956c0c41f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:24:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1089820039',display_name='tempest-TestMinimumBasicScenario-server-1089820039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1089820039',id=27,image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7TqweftpvGTxFNMGY2p7J/kpntHS0bnECu8BSKlj3tRxtCH/m4ubz1lvkhly2e1/752oizHMM2ltDw6dO+diYUA4SAPK2y2zuk8IWkGDyNR4D76Bqzv9XoBgQttZWkZg==',key_name='tempest-TestMinimumBasicScenario-2003992408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-0k0qclfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:24:31Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=99d02fc1-e7f7-4ab7-91a9-7eb738e60da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'pci_devices' on Instance uuid 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:24:33 user nova-compute[74788]:   <uuid>99d02fc1-e7f7-4ab7-91a9-7eb738e60da8</uuid>
Nov 08 15:24:33 user nova-compute[74788]:   <name>instance-0000001b</name>
Nov 08 15:24:33 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:24:33 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:24:33 user nova-compute[74788]:   <metadata>
Nov 08 15:24:33 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:24:33 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:name>tempest-TestMinimumBasicScenario-server-1089820039</nova:name>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:24:33</nova:creationTime>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:24:33 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:24:33 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:owner>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:user uuid="4c06d28d62994d15b3a91c5d210eea4f">tempest-TestMinimumBasicScenario-181050692-project-member</nova:user>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:project uuid="a0f737b11a8d4a88b798295956c0c41f">tempest-TestMinimumBasicScenario-181050692</nova:project>
Nov 08 15:24:33 user nova-compute[74788]:       </nova:owner>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:root type="image" uuid="ffcc8f3a-bdd3-4b06-ae94-e9823a77822d"/>
Nov 08 15:24:33 user nova-compute[74788]:       <nova:ports>
Nov 08 15:24:33 user nova-compute[74788]:         <nova:port uuid="e81cab14-cae2-4400-8807-1fa7237e48f0">
Nov 08 15:24:33 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 15:24:33 user nova-compute[74788]:         </nova:port>
Nov 08 15:24:33 user nova-compute[74788]:       </nova:ports>
Nov 08 15:24:33 user nova-compute[74788]:     </nova:instance>
Nov 08 15:24:33 user nova-compute[74788]:   </metadata>
Nov 08 15:24:33 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:24:33 user nova-compute[74788]:     <system>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="serial">99d02fc1-e7f7-4ab7-91a9-7eb738e60da8</entry>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="uuid">99d02fc1-e7f7-4ab7-91a9-7eb738e60da8</entry>
Nov 08 15:24:33 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:24:33 user nova-compute[74788]:     </system>
Nov 08 15:24:33 user nova-compute[74788]:   </sysinfo>
Nov 08 15:24:33 user nova-compute[74788]:   <os>
Nov 08 15:24:33 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:24:33 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:24:33 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:24:33 user nova-compute[74788]:   </os>
Nov 08 15:24:33 user nova-compute[74788]:   <features>
Nov 08 15:24:33 user nova-compute[74788]:     <acpi/>
Nov 08 15:24:33 user nova-compute[74788]:     <apic/>
Nov 08 15:24:33 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:24:33 user nova-compute[74788]:   </features>
Nov 08 15:24:33 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:24:33 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:24:33 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:24:33 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:24:33 user nova-compute[74788]:   </clock>
Nov 08 15:24:33 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:24:33 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:24:33 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:24:33 user nova-compute[74788]:   </cpu>
Nov 08 15:24:33 user nova-compute[74788]:   <devices>
Nov 08 15:24:33 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:24:33 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:24:33 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk"/>
Nov 08 15:24:33 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:24:33 user nova-compute[74788]:     </disk>
Nov 08 15:24:33 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:24:33 user nova-compute[74788]:       <mac address="fa:16:3e:10:29:77"/>
Nov 08 15:24:33 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:33 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:24:33 user nova-compute[74788]:       <target dev="tape81cab14-ca"/>
Nov 08 15:24:33 user nova-compute[74788]:     </interface>
Nov 08 15:24:33 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:24:33 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/console.log" append="off"/>
Nov 08 15:24:33 user nova-compute[74788]:     </serial>
Nov 08 15:24:33 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:24:33 user nova-compute[74788]:     <video>
Nov 08 15:24:33 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:24:33 user nova-compute[74788]:     </video>
Nov 08 15:24:33 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:24:33 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:24:33 user nova-compute[74788]:     </rng>
Nov 08 15:24:33 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:24:33 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:24:33 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:24:33 user nova-compute[74788]:     </memballoon>
Nov 08 15:24:33 user nova-compute[74788]:   </devices>
Nov 08 15:24:33 user nova-compute[74788]: </domain>
Nov 08 15:24:33 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1089820039',display_name='tempest-TestMinimumBasicScenario-server-1089820039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1089820039',id=27,image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7TqweftpvGTxFNMGY2p7J/kpntHS0bnECu8BSKlj3tRxtCH/m4ubz1lvkhly2e1/752oizHMM2ltDw6dO+diYUA4SAPK2y2zuk8IWkGDyNR4D76Bqzv9XoBgQttZWkZg==',key_name='tempest-TestMinimumBasicScenario-2003992408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-0k0qclfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:24:31Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=99d02fc1-e7f7-4ab7-91a9-7eb738e60da8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG os_vif [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd86aa47a-ca36-505f-b774-d8463818317e', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape81cab14-ca, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape81cab14-ca, col_values=(('qos', UUID('714a3958-736c-4dc6-b2f6-e6ef580b84ab')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape81cab14-ca, col_values=(('external_ids', {'iface-id': 'e81cab14-cae2-4400-8807-1fa7237e48f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:29:77', 'vm-uuid': '99d02fc1-e7f7-4ab7-91a9-7eb738e60da8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:33 user nova-compute[74788]: INFO os_vif [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca')
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:24:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] No VIF found with MAC fa:16:3e:10:29:77, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-changed-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Refreshing instance network info cache due to event network-changed-e81cab14-cae2-4400-8807-1fa7237e48f0. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] Acquiring lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] Acquired lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Refreshing network info cache for port e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Updated VIF entry in instance network info cache for port e81cab14-cae2-4400-8807-1fa7237e48f0. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Updating instance_info_cache with network_info: [{"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc20a885-bf51-47e6-9ae1-d8a382227454 req-6f4ea04d-08e3-425b-808d-de0f4e0b96f7 service nova] Releasing lock "refresh_cache-99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] No waiting events found dispatching network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:35 user nova-compute[74788]: WARNING nova.compute.manager [req-77b163f8-6f46-4b71-808e-b1519814e840 req-7c9d79ad-e396-408d-ba6d-f16027c9a17d service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received unexpected event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 for instance with vm_state building and task_state spawning.
Nov 08 15:24:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] No waiting events found dispatching network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:24:37 user nova-compute[74788]: WARNING nova.compute.manager [req-6a00d19b-28b7-4fb3-9465-27266aeee67c req-17ae89e3-4983-4fc6-8d25-554b2b39f5d1 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received unexpected event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 for instance with vm_state building and task_state spawning.
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:24:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Instance spawned successfully.
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:37 user nova-compute[74788]: INFO nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:24:37 user nova-compute[74788]: INFO nova.compute.manager [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Took 8.03 seconds to build instance.
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ad82dc18-7c1b-49c0-ae83-0169e6c42d9e tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.184s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:37 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:38 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:44 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=25.328929901123047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f09be848-e7e9-4963-a465-28ef011b20b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 996a41db-79b5-4375-82a6-153b3cbd5cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:24:44 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:24:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:24:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:24:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:24:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-changed-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Refreshing instance network info cache due to event network-changed-451bdddb-f4ef-4f81-8c6f-1a087a7cf116. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] Acquiring lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] Acquired lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Refreshing network info cache for port 451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updated VIF entry in instance network info cache for port 451bdddb-f4ef-4f81-8c6f-1a087a7cf116. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating instance_info_cache with network_info: [{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:24:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-10d20ac6-f51b-4f72-b7ad-2c99f03b1e7d req-233a21c9-5b14-47b3-acbe-2082d492acdb service nova] Releasing lock "refresh_cache-2a33da20-7af4-4d6c-8cba-94cf3986245c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG nova.objects.instance [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'flavor' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:24:51 user nova-compute[74788]: INFO nova.compute.manager [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attaching volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b to /dev/vdb
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.utils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1149a4e-0238-48ba-816e-9fe39a4cf24d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da707e9-f333-4c77-bb75-c0d429522738]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[343cc475-869b-4e04-97b1-65e237108224]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614a0c4-b257-4c79-ab15-a10f2f7a2463]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:24:51 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:24:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e81fc9-ac72-4982-b725-1ff687a6a9e5]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG os_brick.utils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:24:51 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating existing volume attachment record: 34df8e95-1382-45c6-8262-ba31a6566cab {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:24:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:24:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:25:00 user nova-compute[74788]: INFO nova.compute.manager [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] instance snapshotting
Nov 08 15:25:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Beginning live snapshot process
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json -f qcow2" returned: 0 in 0.309s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json -f qcow2" returned: 0 in 0.242s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.280s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e.delta 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e.delta 1073741824" returned: 0 in 0.069s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:02 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 15:25:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:25:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:25:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 15:25:03 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:25:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e.delta /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e.delta /opt/stack/data/nova/instances/snapshots/tmpkohkvpnt/de18b907544b440ca0d4533ac32cea9e" returned: 0 in 0.577s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Snapshot extracted, beginning image upload
Nov 08 15:25:06 user nova-compute[74788]: INFO nova.compute.manager [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Rescuing
Nov 08 15:25:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:25:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:25:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:25:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Snapshot image upload complete
Nov 08 15:25:07 user nova-compute[74788]: INFO nova.compute.manager [None req-92c58852-422e-4944-82d7-2919b0d0e0cb tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Took 6.14 seconds to snapshot the instance on the hypervisor.
Nov 08 15:25:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:07 user nova-compute[74788]: WARNING nova.compute.manager [req-eb243978-368e-46b0-a4ca-6e4b8e301edc req-7f2b097a-1805-4069-a536-c57f2093569a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state active and task_state rescuing.
Nov 08 15:25:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance destroyed successfully.
Nov 08 15:25:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Attempting rescue
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:25:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Creating image(s)
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.228s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue" returned: 0 in 0.064s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'migration_context' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.base [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<f4281708-3fc8-480c-9031-62fda80f8940> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start _get_guest_xml network_info=[{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:e3:e4:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04773e08-e579-43f8-a159-498093451850', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.base [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<f4281708-3fc8-480c-9031-62fda80f8940> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'numa_topology' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.base [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<f4281708-3fc8-480c-9031-62fda80f8940> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:25:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.base [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<f4281708-3fc8-480c-9031-62fda80f8940> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-900878772',display_name='tempest-ServerRescueNegativeTestJSON-server-900878772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-900878772',id=19,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:20:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-gtlcuzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:20:28Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=f4281708-3fc8-480c-9031-62fda80f8940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:e3:e4:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:e3:e4:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.objects.base [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<f4281708-3fc8-480c-9031-62fda80f8940> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:25:08 user nova-compute[74788]:   <uuid>f4281708-3fc8-480c-9031-62fda80f8940</uuid>
Nov 08 15:25:08 user nova-compute[74788]:   <name>instance-00000013</name>
Nov 08 15:25:08 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:25:08 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:25:08 user nova-compute[74788]:   <metadata>
Nov 08 15:25:08 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:25:08 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-900878772</nova:name>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:25:08</nova:creationTime>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:25:08 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:25:08 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:owner>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:25:08 user nova-compute[74788]:       </nova:owner>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:25:08 user nova-compute[74788]:       <nova:ports>
Nov 08 15:25:08 user nova-compute[74788]:         <nova:port uuid="2222073c-88d5-40e6-8787-45da953d857a">
Nov 08 15:25:08 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 15:25:08 user nova-compute[74788]:         </nova:port>
Nov 08 15:25:08 user nova-compute[74788]:       </nova:ports>
Nov 08 15:25:08 user nova-compute[74788]:     </nova:instance>
Nov 08 15:25:08 user nova-compute[74788]:   </metadata>
Nov 08 15:25:08 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:25:08 user nova-compute[74788]:     <system>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="serial">f4281708-3fc8-480c-9031-62fda80f8940</entry>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="uuid">f4281708-3fc8-480c-9031-62fda80f8940</entry>
Nov 08 15:25:08 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:25:08 user nova-compute[74788]:     </system>
Nov 08 15:25:08 user nova-compute[74788]:   </sysinfo>
Nov 08 15:25:08 user nova-compute[74788]:   <os>
Nov 08 15:25:08 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:25:08 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:25:08 user nova-compute[74788]:   </os>
Nov 08 15:25:08 user nova-compute[74788]:   <features>
Nov 08 15:25:08 user nova-compute[74788]:     <acpi/>
Nov 08 15:25:08 user nova-compute[74788]:     <apic/>
Nov 08 15:25:08 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:25:08 user nova-compute[74788]:   </features>
Nov 08 15:25:08 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:25:08 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:25:08 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:25:08 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:25:08 user nova-compute[74788]:   </clock>
Nov 08 15:25:08 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:25:08 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:25:08 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:25:08 user nova-compute[74788]:   </cpu>
Nov 08 15:25:08 user nova-compute[74788]:   <devices>
Nov 08 15:25:08 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:25:08 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:25:08 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue"/>
Nov 08 15:25:08 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:25:08 user nova-compute[74788]:     </disk>
Nov 08 15:25:08 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:25:08 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:25:08 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk"/>
Nov 08 15:25:08 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:25:08 user nova-compute[74788]:     </disk>
Nov 08 15:25:08 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:25:08 user nova-compute[74788]:       <mac address="fa:16:3e:e3:e4:f6"/>
Nov 08 15:25:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:08 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:25:08 user nova-compute[74788]:       <target dev="tap2222073c-88"/>
Nov 08 15:25:08 user nova-compute[74788]:     </interface>
Nov 08 15:25:08 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:25:08 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/console.log" append="off"/>
Nov 08 15:25:08 user nova-compute[74788]:     </serial>
Nov 08 15:25:08 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:25:08 user nova-compute[74788]:     <video>
Nov 08 15:25:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:08 user nova-compute[74788]:     </video>
Nov 08 15:25:08 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:25:08 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:25:08 user nova-compute[74788]:     </rng>
Nov 08 15:25:08 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:25:08 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:25:08 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:25:08 user nova-compute[74788]:     </memballoon>
Nov 08 15:25:08 user nova-compute[74788]:   </devices>
Nov 08 15:25:08 user nova-compute[74788]: </domain>
Nov 08 15:25:08 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:25:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance destroyed successfully.
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:e3:e4:f6, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:25:09 user nova-compute[74788]: INFO nova.compute.claims [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Claim successful on node user
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:09 user nova-compute[74788]: WARNING nova.compute.manager [req-1c37215f-6cd7-4b77-a07f-8c749885ac68 req-9dce0849-1216-47da-b28a-33d97f6c4075 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state active and task_state rescuing.
Nov 08 15:25:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:25:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:25:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:25:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG nova.policy [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4568bc1060d24fceba63059e683444bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2ea0f041204b63b39a09e275b340cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:25:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Creating image(s)
Nov 08 15:25:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "/opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "/opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Successfully created port: 0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.part --force-share --output=json" returned: 0 in 0.310s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.virt.images [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] c5714ea6-1a38-4e61-afdc-b22c9129e276 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.part /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:11 user nova-compute[74788]: WARNING nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state active and task_state rescuing.
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:11 user nova-compute[74788]: WARNING nova.compute.manager [req-84b4617e-80f6-4476-a298-c6ed62b346c2 req-0e1e662b-6e8e-4c43-9137-f97cc6a3623a service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state active and task_state rescuing.
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.part /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.converted" returned: 0 in 0.524s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Successfully updated port: 0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquired lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing instance network info cache due to event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] Acquiring lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.337s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating instance_info_cache with network_info: [{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Releasing lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Instance network_info: |[{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] Acquired lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG nova.network.neutron [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618,backing_fmt=raw /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618,backing_fmt=raw /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk 1073741824" returned: 0 in 0.061s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "3b26fa9bad603296fc54ec9a4e3c4d3b0b225618" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Ensure instance console log exists: /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Start _get_guest_xml network_info=[{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e9068b1e266303acf02527530dd202a7',container_format='bare',created_at=2023-11-08T15:25:01Z,direct_url=<?>,disk_format='qcow2',id=c5714ea6-1a38-4e61-afdc-b22c9129e276,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-249138822',owner='ef2ea0f041204b63b39a09e275b340cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:25:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': 'c5714ea6-1a38-4e61-afdc-b22c9129e276'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:25:13 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:13 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e9068b1e266303acf02527530dd202a7',container_format='bare',created_at=2023-11-08T15:25:01Z,direct_url=<?>,disk_format='qcow2',id=c5714ea6-1a38-4e61-afdc-b22c9129e276,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-249138822',owner='ef2ea0f041204b63b39a09e275b340cc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:25:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1665273728',display_name='tempest-TestStampPattern-server-1665273728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1665273728',id=28,image_ref='c5714ea6-1a38-4e61-afdc-b22c9129e276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-pqrcgwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ce357a1e-6baf-4309-8227-6b2c77d2bfe6',image_min_disk='1',image_min_ram='0',image_owner_id='ef2ea0f041204b63b39a09e275b340cc',image_owner_project_name='tempest-TestStampPattern-242603636',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-242603636-project-member',image_user_id='4568bc1060d24fceba63059e683444bd',network_allocated='True',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:25:10Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:25:13 user nova-compute[74788]:   <uuid>8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a</uuid>
Nov 08 15:25:13 user nova-compute[74788]:   <name>instance-0000001c</name>
Nov 08 15:25:13 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:25:13 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:25:13 user nova-compute[74788]:   <metadata>
Nov 08 15:25:13 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:25:13 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:name>tempest-TestStampPattern-server-1665273728</nova:name>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:25:13</nova:creationTime>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:25:13 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:25:13 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:owner>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:user uuid="4568bc1060d24fceba63059e683444bd">tempest-TestStampPattern-242603636-project-member</nova:user>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:project uuid="ef2ea0f041204b63b39a09e275b340cc">tempest-TestStampPattern-242603636</nova:project>
Nov 08 15:25:13 user nova-compute[74788]:       </nova:owner>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:root type="image" uuid="c5714ea6-1a38-4e61-afdc-b22c9129e276"/>
Nov 08 15:25:13 user nova-compute[74788]:       <nova:ports>
Nov 08 15:25:13 user nova-compute[74788]:         <nova:port uuid="0c2a93ba-841e-47fa-b6a2-a9838da965b1">
Nov 08 15:25:13 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 15:25:13 user nova-compute[74788]:         </nova:port>
Nov 08 15:25:13 user nova-compute[74788]:       </nova:ports>
Nov 08 15:25:13 user nova-compute[74788]:     </nova:instance>
Nov 08 15:25:13 user nova-compute[74788]:   </metadata>
Nov 08 15:25:13 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:25:13 user nova-compute[74788]:     <system>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="serial">8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a</entry>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="uuid">8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a</entry>
Nov 08 15:25:13 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:25:13 user nova-compute[74788]:     </system>
Nov 08 15:25:13 user nova-compute[74788]:   </sysinfo>
Nov 08 15:25:13 user nova-compute[74788]:   <os>
Nov 08 15:25:13 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:25:13 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:25:13 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:25:13 user nova-compute[74788]:   </os>
Nov 08 15:25:13 user nova-compute[74788]:   <features>
Nov 08 15:25:13 user nova-compute[74788]:     <acpi/>
Nov 08 15:25:13 user nova-compute[74788]:     <apic/>
Nov 08 15:25:13 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:25:13 user nova-compute[74788]:   </features>
Nov 08 15:25:13 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:25:13 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:25:13 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:25:13 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:25:13 user nova-compute[74788]:   </clock>
Nov 08 15:25:13 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:25:13 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:25:13 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:25:13 user nova-compute[74788]:   </cpu>
Nov 08 15:25:13 user nova-compute[74788]:   <devices>
Nov 08 15:25:13 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:25:13 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:25:13 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk"/>
Nov 08 15:25:13 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:25:13 user nova-compute[74788]:     </disk>
Nov 08 15:25:13 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:25:13 user nova-compute[74788]:       <mac address="fa:16:3e:91:37:86"/>
Nov 08 15:25:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:13 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:25:13 user nova-compute[74788]:       <target dev="tap0c2a93ba-84"/>
Nov 08 15:25:13 user nova-compute[74788]:     </interface>
Nov 08 15:25:13 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:25:13 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/console.log" append="off"/>
Nov 08 15:25:13 user nova-compute[74788]:     </serial>
Nov 08 15:25:13 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:25:13 user nova-compute[74788]:     <video>
Nov 08 15:25:13 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:13 user nova-compute[74788]:     </video>
Nov 08 15:25:13 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:25:13 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:25:13 user nova-compute[74788]:     </rng>
Nov 08 15:25:13 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:25:13 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:25:13 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:25:13 user nova-compute[74788]:     </memballoon>
Nov 08 15:25:13 user nova-compute[74788]:   </devices>
Nov 08 15:25:13 user nova-compute[74788]: </domain>
Nov 08 15:25:13 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1665273728',display_name='tempest-TestStampPattern-server-1665273728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1665273728',id=28,image_ref='c5714ea6-1a38-4e61-afdc-b22c9129e276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-pqrcgwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ce357a1e-6baf-4309-8227-6b2c77d2bfe6',image_min_disk='1',image_min_ram='0',image_owner_id='ef2ea0f041204b63b39a09e275b340cc',image_owner_project_name='tempest-TestStampPattern-242603636',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-242603636-project-member',image_user_id='4568bc1060d24fceba63059e683444bd',network_allocated='True',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:25:10Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG os_vif [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c565c04-08a1-50eb-b2e5-f6e905f29b1a', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c2a93ba-84, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c2a93ba-84, col_values=(('qos', UUID('4baaa78d-bb59-4125-bf94-9da070670d67')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c2a93ba-84, col_values=(('external_ids', {'iface-id': '0c2a93ba-841e-47fa-b6a2-a9838da965b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:37:86', 'vm-uuid': '8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.neutron [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updated VIF entry in instance network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.network.neutron [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating instance_info_cache with network_info: [{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:13 user nova-compute[74788]: INFO os_vif [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84')
Nov 08 15:25:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-09f35e10-bdb4-4523-9da0-021b82465373 req-4dd6bfde-df0a-483c-8310-ef59b87b04d8 service nova] Releasing lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No VIF found with MAC fa:16:3e:91:37:86, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:25:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-51c84e55-df69-4bf0-a27d-88664131ae3b tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:25:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:15 user nova-compute[74788]: DEBUG nova.compute.manager [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] No waiting events found dispatching network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:15 user nova-compute[74788]: WARNING nova.compute.manager [req-91f4de2a-5f3c-44c8-a63a-d6e1f6d846a0 req-5fac4788-3e14-4d5e-9769-4d62f7561b78 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received unexpected event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 for instance with vm_state building and task_state spawning.
Nov 08 15:25:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:16 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:16 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:16 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a75b885-4cd0-42f8-a8c8-1ef37c531d99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:25:16 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.073s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[185115e2-07ac-4bc6-84ad-0399993d0eb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b] added
Nov 08 15:25:16 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[897ef663-e5b9-4244-9d82-5ac65bc0cdd5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9982eed6-5af1-4a2f-8c43-358237736201]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSzsupe {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSzsupe" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dce078-dba7-4bfb-9855-bfeb79b9c33e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUSzsupe'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aa5317-5eff-42df-8377-f757f2753712]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947ccd8-451e-4b40-a67b-4da65ae06af6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:16 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:16 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce5d4f-2311-4c93-bc10-63a6ef11e080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]
Nov 08 15:25:16 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.
Nov 08 15:25:16 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59c0dc-2e79-401c-8ddb-c2066f6c752a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0071b37-d2d3-4aaa-b486-b6298475f3db]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:17 user nova-compute[74788]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:17 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:17 user nova-compute[74788]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:17 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3304d1-d116-4600-b1b8-c4da4afb302d]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] No waiting events found dispatching network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:17 user nova-compute[74788]: WARNING nova.compute.manager [req-406dc88c-864e-4030-89e8-688d2018ee05 req-f97cd4d3-8711-4cd9-95b6-0ddce45e50b6 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received unexpected event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 for instance with vm_state building and task_state spawning.
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:25:17 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Instance spawned successfully.
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:17 user nova-compute[74788]: INFO nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Took 7.47 seconds to spawn the instance on the hypervisor.
Nov 08 15:25:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:25:17 user nova-compute[74788]: INFO nova.compute.manager [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Took 8.52 seconds to build instance.
Nov 08 15:25:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d6705272-3cda-4fad-899f-1324f367aab9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.658s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23736333537356162', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736333537356162', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.objects.instance [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'flavor' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:25:18 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:25:18 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:25:18 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:25:18 user nova-compute[74788]:   <serial>695dc10f-c06b-4c03-b7fc-3aaea4a8f33b</serial>
Nov 08 15:25:18 user nova-compute[74788]: </disk>
Nov 08 15:25:18 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:24:b6:f0, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:25:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fa5fe38b-88cf-4798-bc57-e43ca5bdb8a9 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.442s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:20 user nova-compute[74788]: INFO nova.compute.manager [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Rebuilding instance
Nov 08 15:25:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:25:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:21 user nova-compute[74788]: WARNING nova.compute.manager [req-0418fdf6-dcb9-482a-a828-8da03ebc050c req-9fa76c58-1dae-4ae1-babf-4c1190538545 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state active and task_state rebuilding.
Nov 08 15:25:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance destroyed successfully.
Nov 08 15:25:21 user nova-compute[74788]: INFO nova.compute.manager [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Detaching volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:25:21 user nova-compute[74788]: INFO nova.virt.block_device [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attempting to driver detach volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b from mountpoint /dev/vdb
Nov 08 15:25:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Attempting to detach device vdb from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:25:21 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:25:21 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:25:21 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:25:21 user nova-compute[74788]:   <serial>695dc10f-c06b-4c03-b7fc-3aaea4a8f33b</serial>
Nov 08 15:25:21 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:25:21 user nova-compute[74788]: </disk>
Nov 08 15:25:21 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:25:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully detached device vdb from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the persistent domain config.
Nov 08 15:25:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:21 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:25:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a9bea-2126-4150-beb5-0261ecaf72d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:25:22 user nova-compute[74788]: No targets found.
Nov 08 15:25:22 user nova-compute[74788]: iSNS:
Nov 08 15:25:22 user nova-compute[74788]: No targets found.
Nov 08 15:25:22 user nova-compute[74788]: STATIC:
Nov 08 15:25:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89
Nov 08 15:25:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:25:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:25:22 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:25:22 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:25:22 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:25:22 user nova-compute[74788]: FIRMWARE:
Nov 08 15:25:22 user nova-compute[74788]: No targets found.
Nov 08 15:25:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:25:22 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:25:22 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175c690-612b-41fe-a124-cd441c709fec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0264727a-0263-452a-a351-1ba214435282]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:22 user nova-compute[74788]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:22 user nova-compute[74788]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8a9f6-0647-491a-81df-65d657e175ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe4fff9-3903-45de-ba1b-06c500186010]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b591be2-3726-4b1f-9e5c-15f7866df096]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6a5f6-d45e-4ab5-bde1-90a5e898a60e]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[85176079-84d4-4764-ba36-bf1dbc1c87b9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76fea6-b272-4757-b737-f67147325c15]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]
Nov 08 15:25:22 user nova-compute[74788]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.
Nov 08 15:25:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260e595-d630-4e77-90b0-562815b1f745]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== disconnect_volume: return (373ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:25:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:23 user nova-compute[74788]: WARNING nova.compute.manager [req-2204195a-a122-4392-acc3-98eb8fe2c8b5 req-246f7bd6-bc93-4aeb-8d4f-f6a53101235c service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state active and task_state rebuilding.
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance destroyed successfully.
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-ServerActionsTestOtherA-server-2010389919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451bdddb-f4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f0dcd5f-0c1f-4254-b268-b4cd6f27d1f6) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:23 user nova-compute[74788]: INFO os_vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4')
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:23 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05a253-7e08-4102-a7cc-2791bd58ade0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:25:23 user nova-compute[74788]: No targets found.
Nov 08 15:25:23 user nova-compute[74788]: iSNS:
Nov 08 15:25:23 user nova-compute[74788]: No targets found.
Nov 08 15:25:23 user nova-compute[74788]: STATIC:
Nov 08 15:25:23 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89
Nov 08 15:25:23 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:25:23 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:25:23 user nova-compute[74788]: FIRMWARE:
Nov 08 15:25:23 user nova-compute[74788]: No targets found.
Nov 08 15:25:23 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:25:23 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:25:23 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afe7b13-e738-46f7-a2c4-ed83c9d0d964]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac88e1d-ce88-40c8-81d3-259773f50589]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:23 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:23 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d12d0>, {}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Disconnecting from: [] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== disconnect_volume: return (77ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:25:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Deleting instance files /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c_del
Nov 08 15:25:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Deletion of /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c_del complete
Nov 08 15:25:23 user nova-compute[74788]: INFO nova.virt.block_device [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Booting with volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b at /dev/vdb
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.utils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba2579-450c-47a6-870f-ef49e80409a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d00f9c-8563-4c52-9514-f9cdc20aee92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[85234bb0-34ec-4c61-9467-b0477c90625d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[be946cbd-2481-4fdf-8b60-e4c14db51b55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:25:23 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:25:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae624eb-0829-4ea5-942d-b1b2e56b9da0]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG os_brick.utils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:23 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating existing volume attachment record: 5bca7b22-5c57-4f52-88d9-11b10165f8eb {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:25:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:31 user nova-compute[74788]: INFO nova.compute.manager [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Terminating instance
Nov 08 15:25:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-unplugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] No waiting events found dispatching network-vif-unplugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-f8c21076-cd1b-4eff-9c06-6adb36c291c0 req-7a65c4fe-6bae-47d8-a087-28cd5c0ff4f1 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-unplugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Instance destroyed successfully.
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lazy-loading 'resources' on Instance uuid f09be848-e7e9-4963-a465-28ef011b20b3 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-128467844',display_name='tempest-VolumesActionsTest-instance-128467844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-128467844',id=24,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='599044705f5d49f19ef319ebc7b8f04c',ramdisk_id='',reservation_id='r-pi22kx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-736158225',owner_user_name='tempest-VolumesActionsTest-736158225-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:23:49Z,user_data=None,user_id='471971c5b22e403cb5b2f573b54f8a3d',uuid=f09be848-e7e9-4963-a465-28ef011b20b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converting VIF {"id": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "address": "fa:16:3e:10:7d:c2", "network": {"id": "260760dd-b5e6-4768-854a-bd8912d4cd17", "bridge": "br-int", "label": "tempest-VolumesActionsTest-394040877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "599044705f5d49f19ef319ebc7b8f04c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f32256-17", "ovs_interfaceid": "c3f32256-1752-4719-b0df-d3e4c852cbf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG os_vif [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f32256-17, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=501153fd-09fb-4daa-9885-12bb6b9d8f98) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:32 user nova-compute[74788]: INFO os_vif [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:7d:c2,bridge_name='br-int',has_traffic_filtering=True,id=c3f32256-1752-4719-b0df-d3e4c852cbf1,network=Network(260760dd-b5e6-4768-854a-bd8912d4cd17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f32256-17')
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Deleting instance files /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3_del
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Deletion of /opt/stack/data/nova/instances/f09be848-e7e9-4963-a465-28ef011b20b3_del complete
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.compute.manager [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 08 15:25:32 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-8c80af81-18f4-4817-87a6-e3c569ff73b0 req-cf2728d5-fa01-40b8-ab4f-d7ff8ca1c04f service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-deleted-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.compute.manager [req-8c80af81-18f4-4817-87a6-e3c569ff73b0 req-cf2728d5-fa01-40b8-ab4f-d7ff8ca1c04f service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Neutron deleted interface c3f32256-1752-4719-b0df-d3e4c852cbf1; detaching it from the instance and deleting it from the info cache
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.network.neutron [req-8c80af81-18f4-4817-87a6-e3c569ff73b0 req-cf2728d5-fa01-40b8-ab4f-d7ff8ca1c04f service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:32 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Took 0.53 seconds to deallocate network for instance.
Nov 08 15:25:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-8c80af81-18f4-4817-87a6-e3c569ff73b0 req-cf2728d5-fa01-40b8-ab4f-d7ff8ca1c04f service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Detach interface failed, port_id=c3f32256-1752-4719-b0df-d3e4c852cbf1, reason: Instance f09be848-e7e9-4963-a465-28ef011b20b3 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:33 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Deleted allocations for instance f09be848-e7e9-4963-a465-28ef011b20b3
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cab198b6-36fb-49ab-8683-559db4a81290 tempest-VolumesActionsTest-736158225 tempest-VolumesActionsTest-736158225-project-member] Lock "f09be848-e7e9-4963-a465-28ef011b20b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] Acquiring lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] Lock "f09be848-e7e9-4963-a465-28ef011b20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] No waiting events found dispatching network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:33 user nova-compute[74788]: WARNING nova.compute.manager [req-5cb65710-ef66-4206-8848-ee1c0865f999 req-82d87002-8991-4e3f-a6c6-0ae76c708654 service nova] [instance: f09be848-e7e9-4963-a465-28ef011b20b3] Received unexpected event network-vif-plugged-c3f32256-1752-4719-b0df-d3e4c852cbf1 for instance with vm_state deleted and task_state None.
Nov 08 15:25:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-changed-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Refreshing instance network info cache due to event network-changed-9942c8e9-6b88-49e6-878e-7d4d0b0db18f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] Acquiring lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] Acquired lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:25:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Refreshing network info cache for port 9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:25:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updated VIF entry in instance network info cache for port 9942c8e9-6b88-49e6-878e-7d4d0b0db18f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:25:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating instance_info_cache with network_info: [{"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d998687b-f78d-478e-acfc-2fd3bfca4aff req-7b55b833-418a-4a2a-a750-8b07ddafb28b service nova] Releasing lock "refresh_cache-04fede4a-9cd5-4386-a083-b25334ebbd03" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:25:39 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:25:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 69234b99-1d52-4ea3-a371-b36804e3c314 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updating instance_info_cache with network_info: [{"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-69234b99-1d52-4ea3-a371-b36804e3c314" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:25:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:45 user nova-compute[74788]: INFO nova.compute.manager [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Attaching volume 0ec3453c-8438-4769-b887-068d1cd7bb15 to /dev/vdb
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.utils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c26243-430d-4003-9eb9-f78a420af744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc9c267-9340-4386-99fd-c4a9eaeb9264]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e821256c-f152-4174-88a4-cf4b350c2351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d2e6c-30ca-4bab-af65-914afd07db47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:25:45 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1bb90e-c886-47a4-922c-636a1fd68d7d]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG os_brick.utils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating existing volume attachment record: cf4cb606-6be6-404e-aa6e-ceeb7467adc1 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:25:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7285MB free_disk=25.206275939941406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 996a41db-79b5-4375-82a6-153b3cbd5cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:25:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:25:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Creating image(s)
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk 1073741824" returned: 0 in 0.054s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Cannot resize image /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Ensure instance console log exists: /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start _get_guest_xml network_info=[{"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a33da20-7af4-4d6c-8cba-94cf3986245c', 'attached_at': '', 'detached_at': '', 'volume_id': '695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'serial': '695dc10f-c06b-4c03-b7fc-3aaea4a8f33b'}, 'attachment_id': '5bca7b22-5c57-4f52-88d9-11b10165f8eb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:25:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 15:25:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:25:49 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:49 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:25:49 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415bab5-e6e4-45f7-a70a-c26beced963e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:25:49 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cfbfcd-febd-45f5-9d21-075d7b96c6a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b] added
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d9898-86a4-4470-954b-c29efe1c1db9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a70dbd-ab05-4344-afe9-720562d8d69b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSzsupe {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSzsupe" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a890818-602d-40f9-8ced-2cec6ca060bd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUSzsupe'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d9251-7f10-44a7-af0f-449385371f74]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b312e3-5c40-46fa-a13b-6e791891f8fc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b451b1-82f4-40bb-a6be-ecbbf5f59842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]
Nov 08 15:25:49 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af58c5a-30a2-4edb-a03d-57a9b0864088]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f25f51-0ea5-4f43-9e79-761ce938b706]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:49 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:25:49 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:25:49 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e2aa6-fb45-4c46-84b3-1896fb7baed9]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:25:49 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23736333537356162', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736333537356162', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-ServerActionsTestOtherA-server-2010389919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:25:50 user nova-compute[74788]:   <uuid>2a33da20-7af4-4d6c-8cba-94cf3986245c</uuid>
Nov 08 15:25:50 user nova-compute[74788]:   <name>instance-00000017</name>
Nov 08 15:25:50 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:25:50 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:25:50 user nova-compute[74788]:   <metadata>
Nov 08 15:25:50 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:25:50 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherA-server-2010389919</nova:name>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:25:49</nova:creationTime>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:25:50 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:25:50 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:owner>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:user uuid="30bfaf63a8bf4172b0a72ee8536a76b2">tempest-ServerActionsTestOtherA-27641552-project-member</nova:user>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:project uuid="c097c366f91c496e9f5a4cfaff0e14c6">tempest-ServerActionsTestOtherA-27641552</nova:project>
Nov 08 15:25:50 user nova-compute[74788]:       </nova:owner>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:25:50 user nova-compute[74788]:       <nova:ports>
Nov 08 15:25:50 user nova-compute[74788]:         <nova:port uuid="451bdddb-f4ef-4f81-8c6f-1a087a7cf116">
Nov 08 15:25:50 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:25:50 user nova-compute[74788]:         </nova:port>
Nov 08 15:25:50 user nova-compute[74788]:       </nova:ports>
Nov 08 15:25:50 user nova-compute[74788]:     </nova:instance>
Nov 08 15:25:50 user nova-compute[74788]:   </metadata>
Nov 08 15:25:50 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:25:50 user nova-compute[74788]:     <system>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="serial">2a33da20-7af4-4d6c-8cba-94cf3986245c</entry>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="uuid">2a33da20-7af4-4d6c-8cba-94cf3986245c</entry>
Nov 08 15:25:50 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:25:50 user nova-compute[74788]:     </system>
Nov 08 15:25:50 user nova-compute[74788]:   </sysinfo>
Nov 08 15:25:50 user nova-compute[74788]:   <os>
Nov 08 15:25:50 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:25:50 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:25:50 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:25:50 user nova-compute[74788]:   </os>
Nov 08 15:25:50 user nova-compute[74788]:   <features>
Nov 08 15:25:50 user nova-compute[74788]:     <acpi/>
Nov 08 15:25:50 user nova-compute[74788]:     <apic/>
Nov 08 15:25:50 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:25:50 user nova-compute[74788]:   </features>
Nov 08 15:25:50 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:25:50 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:25:50 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:25:50 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:25:50 user nova-compute[74788]:   </clock>
Nov 08 15:25:50 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:25:50 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:25:50 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:25:50 user nova-compute[74788]:   </cpu>
Nov 08 15:25:50 user nova-compute[74788]:   <devices>
Nov 08 15:25:50 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:25:50 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:25:50 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk"/>
Nov 08 15:25:50 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:25:50 user nova-compute[74788]:     </disk>
Nov 08 15:25:50 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:25:50 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:25:50 user nova-compute[74788]:       <source dev="/dev/sdc"/>
Nov 08 15:25:50 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:25:50 user nova-compute[74788]:       <serial>695dc10f-c06b-4c03-b7fc-3aaea4a8f33b</serial>
Nov 08 15:25:50 user nova-compute[74788]:     </disk>
Nov 08 15:25:50 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:25:50 user nova-compute[74788]:       <mac address="fa:16:3e:24:b6:f0"/>
Nov 08 15:25:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:50 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:25:50 user nova-compute[74788]:       <target dev="tap451bdddb-f4"/>
Nov 08 15:25:50 user nova-compute[74788]:     </interface>
Nov 08 15:25:50 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:25:50 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/console.log" append="off"/>
Nov 08 15:25:50 user nova-compute[74788]:     </serial>
Nov 08 15:25:50 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:25:50 user nova-compute[74788]:     <video>
Nov 08 15:25:50 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:25:50 user nova-compute[74788]:     </video>
Nov 08 15:25:50 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:25:50 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:25:50 user nova-compute[74788]:     </rng>
Nov 08 15:25:50 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:25:50 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:25:50 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:25:50 user nova-compute[74788]:     </memballoon>
Nov 08 15:25:50 user nova-compute[74788]:   </devices>
Nov 08 15:25:50 user nova-compute[74788]: </domain>
Nov 08 15:25:50 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-ServerActionsTestOtherA-server-2010389919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG os_vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '014de124-2867-52e6-a880-5861ce532c33', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451bdddb-f4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap451bdddb-f4, col_values=(('qos', UUID('e28145dd-fd35-47d0-b417-bd618d3f7f1c')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap451bdddb-f4, col_values=(('external_ids', {'iface-id': '451bdddb-f4ef-4f81-8c6f-1a087a7cf116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:b6:f0', 'vm-uuid': '2a33da20-7af4-4d6c-8cba-94cf3986245c'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:50 user nova-compute[74788]: INFO os_vif [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4')
Nov 08 15:25:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:25:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:24:b6:f0, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:52 user nova-compute[74788]: WARNING nova.compute.manager [req-1cf94d37-9cdb-4121-bf41-e5dba1699f6e req-7017148f-a7bb-4344-add4-50e8834bda76 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 15:25:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:54 user nova-compute[74788]: WARNING nova.compute.manager [req-79ddbfff-67b6-440f-b4cf-94e0f921ca73 req-7ab5302f-ea54-42fe-b402-4bbc60ba2edb service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:25:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance spawned successfully.
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74788) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9fcfd732-d801-4ffb-a753-5c5e00a2cbdd tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.094s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:56 user nova-compute[74788]: INFO nova.compute.manager [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Terminating instance
Nov 08 15:25:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e1617ea-50f7-4980-b4a1-48033cd0f1c0 req-4662ee5c-42c3-4765-8753-78cf9045438c service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Instance destroyed successfully.
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lazy-loading 'resources' on Instance uuid 996a41db-79b5-4375-82a6-153b3cbd5cf1 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1632680922',display_name='tempest-VolumesNegativeTest-instance-1632680922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1632680922',id=26,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:24:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a97254dd86e849089302f68dac57dd62',ramdisk_id='',reservation_id='r-b31saqxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-478478059',owner_user_name='tempest-VolumesNegativeTest-478478059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:24:13Z,user_data=None,user_id='8d0153aeff0b48cab43dd5e5efdf8ade',uuid=996a41db-79b5-4375-82a6-153b3cbd5cf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converting VIF {"id": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "address": "fa:16:3e:d1:4f:38", "network": {"id": "1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "254acd68c75a4566a1bb22e22571fa34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ed2f77c-f2", "ovs_interfaceid": "9ed2f77c-f219-4816-a9a6-2f680fd92de9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG os_vif [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ed2f77c-f2, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ed6eddf-f37d-4fc2-a904-7da86d91e992) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: INFO os_vif [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:4f:38,bridge_name='br-int',has_traffic_filtering=True,id=9ed2f77c-f219-4816-a9a6-2f680fd92de9,network=Network(1d7ee1b0-0c3d-457c-ac0b-01f30c7a0916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ed2f77c-f2')
Nov 08 15:25:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Deleting instance files /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1_del
Nov 08 15:25:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Deletion of /opt/stack/data/nova/instances/996a41db-79b5-4375-82a6-153b3cbd5cf1_del complete
Nov 08 15:25:57 user nova-compute[74788]: INFO nova.compute.manager [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 15:25:57 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:58 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Took 0.90 seconds to deallocate network for instance.
Nov 08 15:25:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c5f43e8-a5a7-43fe-8b9d-3dcc206487d3 req-c0a26fcc-0514-4e14-bb10-4154083917f2 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-deleted-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:58 user nova-compute[74788]: INFO nova.compute.manager [req-9c5f43e8-a5a7-43fe-8b9d-3dcc206487d3 req-c0a26fcc-0514-4e14-bb10-4154083917f2 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Neutron deleted interface 9ed2f77c-f219-4816-a9a6-2f680fd92de9; detaching it from the instance and deleting it from the info cache
Nov 08 15:25:58 user nova-compute[74788]: DEBUG nova.network.neutron [req-9c5f43e8-a5a7-43fe-8b9d-3dcc206487d3 req-c0a26fcc-0514-4e14-bb10-4154083917f2 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c5f43e8-a5a7-43fe-8b9d-3dcc206487d3 req-c0a26fcc-0514-4e14-bb10-4154083917f2 service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Detach interface failed, port_id=9ed2f77c-f219-4816-a9a6-2f680fd92de9, reason: Instance 996a41db-79b5-4375-82a6-153b3cbd5cf1 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:59 user nova-compute[74788]: WARNING nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state deleted and task_state None.
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:59 user nova-compute[74788]: WARNING nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state deleted and task_state None.
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:59 user nova-compute[74788]: WARNING nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state deleted and task_state None.
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:59 user nova-compute[74788]: WARNING nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-unplugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state deleted and task_state None.
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Acquiring lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] No waiting events found dispatching network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:25:59 user nova-compute[74788]: WARNING nova.compute.manager [req-adedc2ef-72a9-4f52-8a28-fd35ccb5fc52 req-828bd010-ecd2-44cc-947c-c1ea7ea1330f service nova] [instance: 996a41db-79b5-4375-82a6-153b3cbd5cf1] Received unexpected event network-vif-plugged-9ed2f77c-f219-4816-a9a6-2f680fd92de9 for instance with vm_state deleted and task_state None.
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:25:59 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Deleted allocations for instance 996a41db-79b5-4375-82a6-153b3cbd5cf1
Nov 08 15:25:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e739d538-ff67-47fd-9f5b-900a9adb2420 tempest-VolumesNegativeTest-478478059 tempest-VolumesNegativeTest-478478059-project-member] Lock "996a41db-79b5-4375-82a6-153b3cbd5cf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.687s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDVvdsHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:26:12 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:26:12 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:26:12 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954b787-7ed9-4135-a390-a50ce1d9e3d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:26:12 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce35c956-36bf-47d1-8eb8-5dbcff74d057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15] added
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03abd61-f029-45a0-88c0-634fd42f3236]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e0368-736d-40f5-8fd8-f80b90104129]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDVvdsHm {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDVvdsHm" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3c785-8ec0-4921-bd0b-020cfa00aa61]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fDVvdsHm'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa72673-9c17-475e-970b-243e194d5d1e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[24aef89a-437a-49f5-9048-6c7489be252a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b1583e-7878-4214-be72-1bea9c3cd54f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260]
Nov 08 15:26:12 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260] successful.
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[053170ee-6865-4aa1-b438-076c9b8e1c80]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[55397b7b-0040-45d4-b40c-8f7854a49fb4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:12 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:26:12 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47a724-8f98-4fbd-b28e-a0477f9091ae]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDVvdsHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23265643339373364', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265643339373364', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:26:13 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:26:13 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:26:13 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:26:13 user nova-compute[74788]:   <serial>0ec3453c-8438-4769-b887-068d1cd7bb15</serial>
Nov 08 15:26:13 user nova-compute[74788]: </disk>
Nov 08 15:26:13 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] No VIF found with MAC fa:16:3e:fc:6b:fd, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:26:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2ee21427-b4e0-49b9-854c-7d893dcc923d tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.676s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:20 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:21 user nova-compute[74788]: INFO nova.compute.manager [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Attaching volume 26d55999-9622-4d69-af67-c5bee1c77346 to /dev/vdc
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.utils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c845e39b-ba72-41d4-8784-aed21916d6ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b1314-dd26-463c-a850-ecc2d5719d89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a7e879-bebc-4461-bd2f-c10a62e29565]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d08fa-e3c9-4faf-8612-e2b56249bf8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:26:21 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42fe22-c48b-4b3d-98d6-c72a6f6fb40f]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG os_brick.utils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating existing volume attachment record: 76b53495-2cd1-41e5-b37e-ee5f99383e4e {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:21 user nova-compute[74788]: INFO nova.compute.manager [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Detaching volume 13dcbb24-579b-4cb4-9603-392501381c89
Nov 08 15:26:21 user nova-compute[74788]: INFO nova.virt.block_device [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Attempting to driver detach volume 13dcbb24-579b-4cb4-9603-392501381c89 from mountpoint /dev/vdc
Nov 08 15:26:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Attempting to detach device vdc from instance 751fb539-5e41-405a-af55-40a54d1ce66d from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:26:21 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:26:21 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:26:21 user nova-compute[74788]:   <target dev="vdc" bus="virtio"/>
Nov 08 15:26:21 user nova-compute[74788]:   <serial>13dcbb24-579b-4cb4-9603-392501381c89</serial>
Nov 08 15:26:21 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:26:21 user nova-compute[74788]: </disk>
Nov 08 15:26:21 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:26:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully detached device vdc from instance 751fb539-5e41-405a-af55-40a54d1ce66d from the persistent domain config.
Nov 08 15:26:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 751fb539-5e41-405a-af55-40a54d1ce66d from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:26:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:26:21 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:26:21 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:26:21 user nova-compute[74788]:   <target dev="vdc" bus="virtio"/>
Nov 08 15:26:21 user nova-compute[74788]:   <serial>13dcbb24-579b-4cb4-9603-392501381c89</serial>
Nov 08 15:26:21 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:26:21 user nova-compute[74788]: </disk>
Nov 08 15:26:21 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:26:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:26:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG nova.objects.instance [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'flavor' on Instance uuid 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:26 user nova-compute[74788]: INFO nova.compute.manager [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Attaching volume edace056-7e63-4d07-86de-7d5d769438f3 to /dev/vdb
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.utils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafceb9a-aa0a-4c1e-96d4-e542a46c2e45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[328b8571-a5fd-4cdf-98a3-57256566ff95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51120100-03e6-46d5-821b-4ca3c346f2ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0a7fe-d7ee-4937-8541-f5c4b8cea846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:26:27 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:26:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd447a5c-9ac4-439c-b375-1ebc76542ee7]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG os_brick.utils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Updating existing volume attachment record: 9557bb6b-0f6c-489b-b461-1997a1534cf2 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:39 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 751fb539-5e41-405a-af55-40a54d1ce66d is timed out.
Nov 08 15:26:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully detached device vdc from instance 751fb539-5e41-405a-af55-40a54d1ce66d from the live domain config.
Nov 08 15:26:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nobOMkNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:26:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f018f616-71f4-4f78-9a17-b05cac012a01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:26:42 user nova-compute[74788]: No targets found.
Nov 08 15:26:42 user nova-compute[74788]: iSNS:
Nov 08 15:26:42 user nova-compute[74788]: No targets found.
Nov 08 15:26:42 user nova-compute[74788]: STATIC:
Nov 08 15:26:42 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89
Nov 08 15:26:42 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:26:42 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:26:42 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:26:42 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:26:42 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:26:42 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15
Nov 08 15:26:42 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:26:42 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:26:42 user nova-compute[74788]: FIRMWARE:
Nov 08 15:26:42 user nova-compute[74788]: No targets found.
Nov 08 15:26:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:26:42 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:26:42 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3e97f4-b23d-4eeb-8db7-a0413e5bb603]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e46735-327e-4ab4-af74-613ca25e9f01]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:42 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:42 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:26:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 (non-flash)
Nov 08 15:26:42 user nova-compute[74788]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:26:42 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:26:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c3311b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[54194139-4eee-4d0f-b185-d614e29a3479]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7a090-6877-4c20-8a75-7662029a2bcb]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3c1ad-fae9-4cce-8dd0-d16071e22dfa]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e75223a-1403-40f5-9bf6-4a9be4f532d7]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd619d-631a-4da1-8638-a9fecfe57037]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe0920-a2c0-4cc4-85e2-d0c0e5325d62]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260]
Nov 08 15:26:42 user nova-compute[74788]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89, portal: 172.16.0.220,3260] successful.
Nov 08 15:26:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13dcbb24-579b-4cb4-9603-392501381c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b77aa-5b34-4a68-8814-ad429c0b617b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] <== disconnect_volume: return (352ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'flavor' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7de6eba4-dd14-4193-82a0-b979a8d92380 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.volume.cinder [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Update attachment failed for attachment 76b53495-2cd1-41e5-b37e-ee5f99383e4e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Failed to attach 26d55999-9622-4d69-af67-c5bee1c77346 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Traceback (most recent call last):
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     self._volume_attach(context, volume, connector, instance,
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     connection_info = volume_api.attachment_update(
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     res = method(self, ctx, *args, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     with excutils.save_and_reraise_exception():
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     self.force_reraise()
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     raise self.value
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     return method.func(obj, *args, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     return self.request(url, method, **kwargs)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03]     raise exceptions.from_response(resp, body)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791)
Nov 08 15:26:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] 
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.045s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.volume.cinder [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Update attachment failed for attachment 9557bb6b-0f6c-489b-b461-1997a1534cf2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Failed to attach edace056-7e63-4d07-86de-7d5d769438f3 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Traceback (most recent call last):
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     self._volume_attach(context, volume, connector, instance,
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     connection_info = volume_api.attachment_update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     res = method(self, ctx, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     return method.func(obj, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     return self.request(url, method, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8]     raise exceptions.from_response(resp, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092)
Nov 08 15:26:44 user nova-compute[74788]: ERROR nova.compute.manager [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] 
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server [None req-6f200ef8-119e-45d6-9c52-aab0d1829eb6 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-18c29787-fec6-4825-a482-684b7b40e791)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server 
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.502s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server [None req-85dcd2a1-7881-4a1e-aa3e-e8b809b50157 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d0c5c36d-9cc0-4230-b965-2fa34d3e9092)
Nov 08 15:26:44 user nova-compute[74788]: ERROR oslo_messaging.rpc.server 
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:26:45 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:26:45 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.19322967529297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 751fb539-5e41-405a-af55-40a54d1ce66d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:26:45 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:26:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:26:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:26:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:26:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:26:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:57 user nova-compute[74788]: INFO nova.compute.manager [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Unrescuing
Nov 08 15:26:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:26:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'flavor' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:26:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:26:59 user nova-compute[74788]: WARNING nova.compute.manager [req-6e78d03f-22a3-4fc4-8795-38414a8a1973 req-39e95541-1fc4-4cfd-98c1-6cb6704653a3 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:26:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance destroyed successfully.
Nov 08 15:27:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing instance network info cache due to event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] Acquiring lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] Acquired lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updated VIF entry in instance network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.network.neutron [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating instance_info_cache with network_info: [{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-af1197f0-c487-4431-b504-b307cf5a65e0 req-2e71c4f0-f5ed-498f-8bbe-8f70854d8dd3 service nova] Releasing lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG nova.objects.instance [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:27:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:02 user nova-compute[74788]: INFO nova.compute.manager [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Attaching volume 09c405e4-1402-4e79-878c-c2ef10f9d12c to /dev/vdb
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:02 user nova-compute[74788]: WARNING nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:02 user nova-compute[74788]: WARNING nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:02 user nova-compute[74788]: WARNING nova.compute.manager [req-cc1020b0-9843-4203-a48b-913064aebbe8 req-c0c4fba3-67d3-47c7-ac5c-5881511ff3da service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.utils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a2124d-6690-4525-bc9c-9bf9f5f9056c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e202f4d-064e-431b-a55f-69a915778f7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a028def4-02ff-4815-971b-f9d458d3b1e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15a9a7f-b4d7-484f-a104-db9156428a28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:27:02 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:27:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df8540-2a74-46c0-a160-676192935716]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG os_brick.utils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating existing volume attachment record: 96318e73-6af0-4e02-bddc-a536c38d0c3d {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f31ea8f1-96b2-4b9d-ba14-fc37effd3a0d tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:27:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:11 user nova-compute[74788]: INFO nova.compute.manager [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Terminating instance
Nov 08 15:27:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-91e573bc-689e-40d3-802c-c8808bc23d4b req-a56e70a4-cd37-49e6-9947-ebee5f483ee8 service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-unplugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Instance destroyed successfully.
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'resources' on Instance uuid 751fb539-5e41-405a-af55-40a54d1ce66d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-56075347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-56075347',id=17,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwypp1+8dqzzWKrglx0S05tZL9dCcJrjeCyAUldZ8pXOhaThF/DqUrfT7pCM2CPJX2YwUx7FPEawhmk1uoIQR9v6zmQPEBG82ScolKxKeHtXkYk1J/bCxKdHUTVfRcgnw==',key_name='tempest-keypair-1161035840',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:24:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-wlyas5fn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=751fb539-5e41-405a-af55-40a54d1ce66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "fe1e7383-efd7-4e26-820a-28556fe554c1", "address": "fa:16:3e:34:2d:ca", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1e7383-ef", "ovs_interfaceid": "fe1e7383-efd7-4e26-820a-28556fe554c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG os_vif [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1e7383-ef, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b774649b-93c1-4a78-b43e-a0efeb808ec9) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: INFO os_vif [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:2d:ca,bridge_name='br-int',has_traffic_filtering=True,id=fe1e7383-efd7-4e26-820a-28556fe554c1,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1e7383-ef')
Nov 08 15:27:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Deleting instance files /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d_del
Nov 08 15:27:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Deletion of /opt/stack/data/nova/instances/751fb539-5e41-405a-af55-40a54d1ce66d_del complete
Nov 08 15:27:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:12 user nova-compute[74788]: INFO nova.compute.manager [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 15:27:12 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:27:12 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:27:14 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Took 1.24 seconds to deallocate network for instance.
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] Acquiring lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] Lock "751fb539-5e41-405a-af55-40a54d1ce66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] No waiting events found dispatching network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:14 user nova-compute[74788]: WARNING nova.compute.manager [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received unexpected event network-vif-plugged-fe1e7383-efd7-4e26-820a-28556fe554c1 for instance with vm_state deleted and task_state None.
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-dda5786e-295f-44fb-936c-a2ca083ec18b req-c0b884de-7e0b-442a-b0ef-ff60e2134e0f service nova] [instance: 751fb539-5e41-405a-af55-40a54d1ce66d] Received event network-vif-deleted-fe1e7383-efd7-4e26-820a-28556fe554c1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:14 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Deleted allocations for instance 751fb539-5e41-405a-af55-40a54d1ce66d
Nov 08 15:27:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c60f5fa1-9b99-4333-9be5-33afda051803 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "751fb539-5e41-405a-af55-40a54d1ce66d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:27:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:27:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:40 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:41 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkVXzOLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:27:43 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:27:43 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:27:43 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f240d-c918-424a-b510-5c9f93ea8341]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:27:43 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f912930-58e5-40e9-af58-23520588855b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c] added
Nov 08 15:27:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9715fbea-5f9c-4aea-afdf-98c0bc22b3fa]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531e0fc-d551-4678-b157-f2a63c92364e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkVXzOLb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkVXzOLb" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e14b12-11e7-4e12-9b54-dfb20607707d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TkVXzOLb'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93063fcb-95d3-4808-af46-97c59252a041]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c42787-a361-4c74-8ee3-041a54703f2b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:27:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:27:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0341025-01a7-4399-9001-1e552248ca66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260]
Nov 08 15:27:44 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260] successful.
Nov 08 15:27:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9578bd-ac37-4686-8d22-5ea84f7061ee]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee025c2-4666-4dac-a4b0-0318c24ffed8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)
Nov 08 15:27:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:27:44 user nova-compute[74788]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)
Nov 08 15:27:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a09b04-6de3-4505-91a8-32d58a522641]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkVXzOLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26261376134386330', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261376134386330', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:27:45 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:27:45 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:27:45 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:27:45 user nova-compute[74788]:   <serial>09c405e4-1402-4e79-878c-c2ef10f9d12c</serial>
Nov 08 15:27:45 user nova-compute[74788]: </disk>
Nov 08 15:27:45 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] No VIF found with MAC fa:16:3e:91:37:86, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:27:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-49b4801b-a3d9-4111-959d-91184ad988a3 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.927s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:27:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:27:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.20838165283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 69234b99-1d52-4ea3-a371-b36804e3c314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:27:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.821s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:48 user nova-compute[74788]: INFO nova.compute.manager [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Detaching volume 09c405e4-1402-4e79-878c-c2ef10f9d12c
Nov 08 15:27:48 user nova-compute[74788]: INFO nova.virt.block_device [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Attempting to driver detach volume 09c405e4-1402-4e79-878c-c2ef10f9d12c from mountpoint /dev/vdb
Nov 08 15:27:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Attempting to detach device vdb from instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:27:48 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:27:48 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:27:48 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:27:48 user nova-compute[74788]:   <serial>09c405e4-1402-4e79-878c-c2ef10f9d12c</serial>
Nov 08 15:27:48 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:27:48 user nova-compute[74788]: </disk>
Nov 08 15:27:48 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:27:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully detached device vdb from instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a from the persistent domain config.
Nov 08 15:27:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:27:48 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:27:48 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:27:48 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:27:48 user nova-compute[74788]:   <serial>09c405e4-1402-4e79-878c-c2ef10f9d12c</serial>
Nov 08 15:27:48 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:27:48 user nova-compute[74788]: </disk>
Nov 08 15:27:48 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:27:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:27:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:27:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:27:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:55 user nova-compute[74788]: INFO nova.compute.manager [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Terminating instance
Nov 08 15:27:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-unplugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] No waiting events found dispatching network-vif-unplugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-44fbea66-9a4a-44c9-bcd8-6de4e8f9fd06 req-ed3b85e7-6357-4c81-8a0f-1ca21ba56a45 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-unplugged-56602e5f-259d-4910-a8ee-4b90567087a2 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:27:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Instance destroyed successfully.
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lazy-loading 'resources' on Instance uuid 69234b99-1d52-4ea3-a371-b36804e3c314 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1837873673',display_name='tempest-ServersNegativeTestJSON-server-1837873673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1837873673',id=14,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3cd17a9a5cd463ea901bc494dec7a78',ramdisk_id='',reservation_id='r-mnuo37rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1624352802',owner_user_name='tempest-ServersNegativeTestJSON-1624352802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:18:28Z,user_data=None,user_id='d9364a17762748f3a27b326ad597b5c0',uuid=69234b99-1d52-4ea3-a371-b36804e3c314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converting VIF {"id": "56602e5f-259d-4910-a8ee-4b90567087a2", "address": "fa:16:3e:84:b2:fa", "network": {"id": "37faa24a-e1cf-4113-ad9e-09bfe6db374e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-126753413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3cd17a9a5cd463ea901bc494dec7a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56602e5f-25", "ovs_interfaceid": "56602e5f-259d-4910-a8ee-4b90567087a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG os_vif [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56602e5f-25, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34697135-8ecb-4f21-8262-4fdc42d2c2e8) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:27:56 user nova-compute[74788]: INFO os_vif [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b2:fa,bridge_name='br-int',has_traffic_filtering=True,id=56602e5f-259d-4910-a8ee-4b90567087a2,network=Network(37faa24a-e1cf-4113-ad9e-09bfe6db374e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56602e5f-25')
Nov 08 15:27:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Deleting instance files /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314_del
Nov 08 15:27:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Deletion of /opt/stack/data/nova/instances/69234b99-1d52-4ea3-a371-b36804e3c314_del complete
Nov 08 15:27:56 user nova-compute[74788]: INFO nova.compute.manager [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 15:27:56 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:27:56 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Took 0.54 seconds to deallocate network for instance.
Nov 08 15:27:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-b03e7b9b-3374-4033-b7fd-8a3dd6632283 req-211309a3-9ed4-4df5-a1bc-9c5e16271ba0 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-deleted-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:57 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:27:57 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:27:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:57 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Deleted allocations for instance 69234b99-1d52-4ea3-a371-b36804e3c314
Nov 08 15:27:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-290ec1e8-aeee-4f1d-bb4f-8e47a8c1752c tempest-ServersNegativeTestJSON-1624352802 tempest-ServersNegativeTestJSON-1624352802-project-member] Lock "69234b99-1d52-4ea3-a371-b36804e3c314" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:27:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] Acquiring lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:27:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:27:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] Lock "69234b99-1d52-4ea3-a371-b36804e3c314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:27:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] No waiting events found dispatching network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:27:58 user nova-compute[74788]: WARNING nova.compute.manager [req-90375f66-7212-4c65-b417-93dcc82783d0 req-f2005291-b258-48b9-b1fd-25c1d57f3437 service nova] [instance: 69234b99-1d52-4ea3-a371-b36804e3c314] Received unexpected event network-vif-plugged-56602e5f-259d-4910-a8ee-4b90567087a2 for instance with vm_state deleted and task_state None.
Nov 08 15:28:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "f4281708-3fc8-480c-9031-62fda80f8940" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "f4281708-3fc8-480c-9031-62fda80f8940" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:28:06 user nova-compute[74788]: INFO nova.compute.claims [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Claim successful on node user
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:28:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:28:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.policy [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6455bc0197734cce88c64797bd83fc2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fac0333dca24d81b8127258c41a3145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:28:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Creating image(s)
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk 1073741824" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Successfully created port: 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Cannot resize image /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Ensure instance console log exists: /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Successfully updated port: 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing instance network info cache due to event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance network_info: |[{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start _get_guest_xml network_info=[{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:28:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:28:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCibB0yyuXrZ3CTeTiEDSDGlXqipDK/7qt+NPNltQbiMhjo3HOgAuZjwgreV+rXAqbrWxXpu+KpCW3T6x19pDexYVxbVSzsKIhiWO3Gz+OKpQ8VFtRoI9lphje7yL6ODw==',key_name='tempest-keypair-156181796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_devices' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:28:08 user nova-compute[74788]:   <uuid>e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</uuid>
Nov 08 15:28:08 user nova-compute[74788]:   <name>instance-0000001d</name>
Nov 08 15:28:08 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:28:08 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:28:08 user nova-compute[74788]:   <metadata>
Nov 08 15:28:08 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:28:08 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-671099388</nova:name>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:28:08</nova:creationTime>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:28:08 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:28:08 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:owner>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:user uuid="6455bc0197734cce88c64797bd83fc2b">tempest-AttachVolumeShelveTestJSON-300191316-project-member</nova:user>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:project uuid="6fac0333dca24d81b8127258c41a3145">tempest-AttachVolumeShelveTestJSON-300191316</nova:project>
Nov 08 15:28:08 user nova-compute[74788]:       </nova:owner>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:28:08 user nova-compute[74788]:       <nova:ports>
Nov 08 15:28:08 user nova-compute[74788]:         <nova:port uuid="07e83f52-b0ec-4065-a1cf-a1064fa5cbbd">
Nov 08 15:28:08 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 15:28:08 user nova-compute[74788]:         </nova:port>
Nov 08 15:28:08 user nova-compute[74788]:       </nova:ports>
Nov 08 15:28:08 user nova-compute[74788]:     </nova:instance>
Nov 08 15:28:08 user nova-compute[74788]:   </metadata>
Nov 08 15:28:08 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:28:08 user nova-compute[74788]:     <system>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="serial">e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</entry>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="uuid">e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</entry>
Nov 08 15:28:08 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:28:08 user nova-compute[74788]:     </system>
Nov 08 15:28:08 user nova-compute[74788]:   </sysinfo>
Nov 08 15:28:08 user nova-compute[74788]:   <os>
Nov 08 15:28:08 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:28:08 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:28:08 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:28:08 user nova-compute[74788]:   </os>
Nov 08 15:28:08 user nova-compute[74788]:   <features>
Nov 08 15:28:08 user nova-compute[74788]:     <acpi/>
Nov 08 15:28:08 user nova-compute[74788]:     <apic/>
Nov 08 15:28:08 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:28:08 user nova-compute[74788]:   </features>
Nov 08 15:28:08 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:28:08 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:28:08 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:28:08 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:28:08 user nova-compute[74788]:   </clock>
Nov 08 15:28:08 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:28:08 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:28:08 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:28:08 user nova-compute[74788]:   </cpu>
Nov 08 15:28:08 user nova-compute[74788]:   <devices>
Nov 08 15:28:08 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:28:08 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:28:08 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk"/>
Nov 08 15:28:08 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:28:08 user nova-compute[74788]:     </disk>
Nov 08 15:28:08 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:28:08 user nova-compute[74788]:       <mac address="fa:16:3e:e0:ee:ef"/>
Nov 08 15:28:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:28:08 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:28:08 user nova-compute[74788]:       <target dev="tap07e83f52-b0"/>
Nov 08 15:28:08 user nova-compute[74788]:     </interface>
Nov 08 15:28:08 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:28:08 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/console.log" append="off"/>
Nov 08 15:28:08 user nova-compute[74788]:     </serial>
Nov 08 15:28:08 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:28:08 user nova-compute[74788]:     <video>
Nov 08 15:28:08 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:28:08 user nova-compute[74788]:     </video>
Nov 08 15:28:08 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:28:08 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:28:08 user nova-compute[74788]:     </rng>
Nov 08 15:28:08 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:28:08 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:28:08 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:28:08 user nova-compute[74788]:     </memballoon>
Nov 08 15:28:08 user nova-compute[74788]:   </devices>
Nov 08 15:28:08 user nova-compute[74788]: </domain>
Nov 08 15:28:08 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCibB0yyuXrZ3CTeTiEDSDGlXqipDK/7qt+NPNltQbiMhjo3HOgAuZjwgreV+rXAqbrWxXpu+KpCW3T6x19pDexYVxbVSzsKIhiWO3Gz+OKpQ8VFtRoI9lphje7yL6ODw==',key_name='tempest-keypair-156181796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG os_vif [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dc30c85-0b1e-5a9e-aa3d-bfb062ef88b4', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07e83f52-b0, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07e83f52-b0, col_values=(('qos', UUID('72b42e64-d8a8-44dd-b68c-6c2056aecaae')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07e83f52-b0, col_values=(('external_ids', {'iface-id': '07e83f52-b0ec-4065-a1cf-a1064fa5cbbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ee:ef', 'vm-uuid': 'e162d6d0-3c7d-4b87-8b39-09c17d2fadb6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:08 user nova-compute[74788]: INFO os_vif [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0')
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:28:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No VIF found with MAC fa:16:3e:e0:ee:ef, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:28:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a is timed out.
Nov 08 15:28:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully detached device vdb from instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a from the live domain config.
Nov 08 15:28:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkVXzOLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:28:09 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a5e70-acb5-4490-a0bd-be3442b1f232]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:28:09 user nova-compute[74788]: No targets found.
Nov 08 15:28:09 user nova-compute[74788]: iSNS:
Nov 08 15:28:09 user nova-compute[74788]: No targets found.
Nov 08 15:28:09 user nova-compute[74788]: STATIC:
Nov 08 15:28:09 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c
Nov 08 15:28:09 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:28:09 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:28:09 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:28:09 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:28:09 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:28:09 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15
Nov 08 15:28:09 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:28:09 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:28:09 user nova-compute[74788]: FIRMWARE:
Nov 08 15:28:09 user nova-compute[74788]: No targets found.
Nov 08 15:28:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:28:09 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:28:09 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9149bef-14e9-494c-9842-1e7027cb12bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cba1f3-0ca7-4200-90fb-f06761be3dda]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:28:09 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:28:09 user nova-compute[74788]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)
Nov 08 15:28:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:28:09 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:28:09 user nova-compute[74788]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c (non-flash)
Nov 08 15:28:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758583370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02867f7-832d-48a2-9067-37d94172d8ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updated VIF entry in instance network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG nova.network.neutron [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ec8f569-53a9-4e5f-949c-3b00a837e26a req-b85e9b92-0c85-437e-b5f4-e5d2d4f548f4 service nova] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5914da70-f76b-4b2f-b2e9-6a1f29c44365]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836dc9c-720a-40dd-a097-49d612c1d868]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[27312c7c-7984-4fbb-ae82-ae6e62060fbc]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc0652-b0dc-4053-9100-af311e5b7e73]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ac813-70ad-4e4a-ae1c-8f2627e9706d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260]
Nov 08 15:28:09 user nova-compute[74788]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c, portal: 172.16.0.220,3260] successful.
Nov 08 15:28:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c405e4-1402-4e79-878c-c2ef10f9d12c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b9c62a-89ea-494b-8a67-b0a8f3203149]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] <== disconnect_volume: return (313ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:28:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:28:10 user nova-compute[74788]: WARNING nova.compute.manager [req-8dd19d9c-2820-44d2-b5c4-2ed7083b9486 req-8b0165d4-7cf1-4af4-9229-0d22de7f44b4 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state building and task_state spawning.
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.compute.manager [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Detaching volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.virt.block_device [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Attempting to driver detach volume 695dc10f-c06b-4c03-b7fc-3aaea4a8f33b from mountpoint /dev/vdb
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:28:12 user nova-compute[74788]: WARNING nova.compute.manager [req-d34240fa-e47e-4127-b35c-ee25c2340c4f req-76324322-7b56-4e14-bfec-996e813da6d9 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state building and task_state spawning.
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Attempting to detach device vdb from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:28:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:28:12 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:28:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:28:12 user nova-compute[74788]:   <serial>695dc10f-c06b-4c03-b7fc-3aaea4a8f33b</serial>
Nov 08 15:28:12 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:28:12 user nova-compute[74788]: </disk>
Nov 08 15:28:12 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance spawned successfully.
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully detached device vdb from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the persistent domain config.
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:28:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:28:12 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:28:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:28:12 user nova-compute[74788]:   <serial>695dc10f-c06b-4c03-b7fc-3aaea4a8f33b</serial>
Nov 08 15:28:12 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 15:28:12 user nova-compute[74788]: </disk>
Nov 08 15:28:12 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 08 15:28:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:28:12 user nova-compute[74788]: INFO nova.compute.manager [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Took 6.28 seconds to build instance.
Nov 08 15:28:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7c05e898-1893-4de8-9673-eaa2d92082f0 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.386s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:28:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:16 user nova-compute[74788]: DEBUG nova.objects.instance [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'flavor' on Instance uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:28:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-809e8c6c-58da-44c7-93f7-7f57e446adfe tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.817s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.158s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c is timed out.
Nov 08 15:28:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully detached device vdb from instance 2a33da20-7af4-4d6c-8cba-94cf3986245c from the live domain config.
Nov 08 15:28:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSzsupe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:28:33 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[15206730-c257-4001-bb1e-239614b4aa1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:28:33 user nova-compute[74788]: No targets found.
Nov 08 15:28:33 user nova-compute[74788]: iSNS:
Nov 08 15:28:33 user nova-compute[74788]: No targets found.
Nov 08 15:28:33 user nova-compute[74788]: STATIC:
Nov 08 15:28:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b
Nov 08 15:28:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:28:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:28:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15
Nov 08 15:28:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:28:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:28:33 user nova-compute[74788]: FIRMWARE:
Nov 08 15:28:33 user nova-compute[74788]: No targets found.
Nov 08 15:28:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:28:33 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:28:33 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae7b78-52ec-47ee-a55d-0767e6612b38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225fa62-f5ca-4367-b6ec-54310d8f2259]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:28:33 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:28:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b (non-flash)
Nov 08 15:28:33 user nova-compute[74788]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:28:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7797f31f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb5470b-a2fd-425b-b384-ca8c999e6cc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c91bf-3391-4b60-911f-cfb20f586b53]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec719459-9702-474c-b508-36c756f29873]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[84350935-b885-40ad-9690-359dd7595281]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f150131-4fa2-4cb5-9c0f-bf04154d5492]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e609e-ccca-4358-b3fe-dbc40e173fd8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260]
Nov 08 15:28:33 user nova-compute[74788]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b, portal: 172.16.0.220,3260] successful.
Nov 08 15:28:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc10f-c06b-4c03-b7fc-3aaea4a8f33b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[86066cb4-cd33-4a3f-82ae-c45359ebfd04]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== disconnect_volume: return (306ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:28:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:34 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'flavor' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:28:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2b0fd52d-b9c0-4468-8461-f61d92e63a7e tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing instance network info cache due to event network-changed-0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] Acquiring lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] Acquired lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Refreshing network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:39 user nova-compute[74788]: INFO nova.compute.manager [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Terminating instance
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updated VIF entry in instance network info cache for port 0c2a93ba-841e-47fa-b6a2-a9838da965b1. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating instance_info_cache with network_info: [{"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-35986516-ca5c-4844-8107-fa66f3586372 req-5299c94b-d524-4edc-901b-4b5459640167 service nova] Releasing lock "refresh_cache-8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-unplugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] No waiting events found dispatching network-vif-unplugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:28:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-d616e718-4b15-444b-8801-d2e1aaa2939a req-3faf3940-ad95-4a95-81e3-3eb4600a9b91 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-unplugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:28:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Instance destroyed successfully.
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'resources' on Instance uuid 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1665273728',display_name='tempest-TestStampPattern-server-1665273728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1665273728',id=28,image_ref='c5714ea6-1a38-4e61-afdc-b22c9129e276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:25:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-pqrcgwpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ce357a1e-6baf-4309-8227-6b2c77d2bfe6',image_min_disk='1',image_min_ram='0',image_owner_id='ef2ea0f041204b63b39a09e275b340cc',image_owner_project_name='tempest-TestStampPattern-242603636',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-242603636-project-member',image_user_id='4568bc1060d24fceba63059e683444bd',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:25:18Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "address": "fa:16:3e:91:37:86", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2a93ba-84", "ovs_interfaceid": "0c2a93ba-841e-47fa-b6a2-a9838da965b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG os_vif [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c2a93ba-84, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4baaa78d-bb59-4125-bf94-9da070670d67) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:40 user nova-compute[74788]: INFO os_vif [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:37:86,bridge_name='br-int',has_traffic_filtering=True,id=0c2a93ba-841e-47fa-b6a2-a9838da965b1,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2a93ba-84')
Nov 08 15:28:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Deleting instance files /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a_del
Nov 08 15:28:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Deletion of /opt/stack/data/nova/instances/8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a_del complete
Nov 08 15:28:40 user nova-compute[74788]: INFO nova.compute.manager [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 15:28:40 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:28:40 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:28:41 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Took 0.73 seconds to deallocate network for instance.
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-be454eed-f759-4183-9f2f-54a8daa1fecb req-7fd5fc1f-7446-41de-af31-bdeb064dc5b4 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-deleted-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:41 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Deleted allocations for instance 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cde3b72a-1e89-476b-a1f0-91e27d62a4a5 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] Acquiring lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] Lock "8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] No waiting events found dispatching network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:28:41 user nova-compute[74788]: WARNING nova.compute.manager [req-7e23861c-f492-44c8-a453-df2257fa5425 req-721a43a7-5cab-4dc0-a88b-385eceda2ae9 service nova] [instance: 8b6a9a8a-d880-4dac-b2d4-2d7e2d47c77a] Received unexpected event network-vif-plugged-0c2a93ba-841e-47fa-b6a2-a9838da965b1 for instance with vm_state deleted and task_state None.
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:28:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:28:46 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=25.204349517822266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 2a33da20-7af4-4d6c-8cba-94cf3986245c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:28:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:28:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:28:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:28:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:58 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:28:58 user nova-compute[74788]: INFO nova.compute.claims [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Claim successful on node user
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:28:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:28:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Creating image(s)
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG nova.policy [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfd067f5d7d64fd38a5599a0cf4db51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c4a8437a8a4c54bef06408109fca0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:28:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk 1073741824" returned: 0 in 0.055s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Cannot resize image /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Ensure instance console log exists: /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Successfully created port: 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Successfully updated port: 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing instance network info cache due to event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance network_info: |[{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start _get_guest_xml network_info=[{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:29:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-973903588',display_name='tempest-ServerRescueNegativeTestJSON-server-973903588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-973903588',id=30,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3iVkBxwB1fgnj77Aiv07aPCz6xIpN4Tg3N6BHAMkCNe3ydN1cAAo3lCiJ0k5smk1mIni4gip8wWrqcxJRGL9jCepn1Y9xEZUBrHIcCEhlx9MXIHjMU0DhEHu9j5UYZ5w==',key_name='tempest-keypair-1459817029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-t3yqqs28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:29:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=e824084b-42b2-4833-b14f-958ec30156a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:29:02 user nova-compute[74788]:   <uuid>e824084b-42b2-4833-b14f-958ec30156a8</uuid>
Nov 08 15:29:02 user nova-compute[74788]:   <name>instance-0000001e</name>
Nov 08 15:29:02 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:29:02 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:29:02 user nova-compute[74788]:   <metadata>
Nov 08 15:29:02 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:29:02 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-973903588</nova:name>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:29:02</nova:creationTime>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:29:02 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:29:02 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:owner>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:29:02 user nova-compute[74788]:       </nova:owner>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:29:02 user nova-compute[74788]:       <nova:ports>
Nov 08 15:29:02 user nova-compute[74788]:         <nova:port uuid="5b2757df-faeb-4fdb-8add-612e784b5195">
Nov 08 15:29:02 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 15:29:02 user nova-compute[74788]:         </nova:port>
Nov 08 15:29:02 user nova-compute[74788]:       </nova:ports>
Nov 08 15:29:02 user nova-compute[74788]:     </nova:instance>
Nov 08 15:29:02 user nova-compute[74788]:   </metadata>
Nov 08 15:29:02 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:29:02 user nova-compute[74788]:     <system>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="serial">e824084b-42b2-4833-b14f-958ec30156a8</entry>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="uuid">e824084b-42b2-4833-b14f-958ec30156a8</entry>
Nov 08 15:29:02 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:29:02 user nova-compute[74788]:     </system>
Nov 08 15:29:02 user nova-compute[74788]:   </sysinfo>
Nov 08 15:29:02 user nova-compute[74788]:   <os>
Nov 08 15:29:02 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:29:02 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:29:02 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:29:02 user nova-compute[74788]:   </os>
Nov 08 15:29:02 user nova-compute[74788]:   <features>
Nov 08 15:29:02 user nova-compute[74788]:     <acpi/>
Nov 08 15:29:02 user nova-compute[74788]:     <apic/>
Nov 08 15:29:02 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:29:02 user nova-compute[74788]:   </features>
Nov 08 15:29:02 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:29:02 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:29:02 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:29:02 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:29:02 user nova-compute[74788]:   </clock>
Nov 08 15:29:02 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:29:02 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:29:02 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:29:02 user nova-compute[74788]:   </cpu>
Nov 08 15:29:02 user nova-compute[74788]:   <devices>
Nov 08 15:29:02 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:29:02 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:29:02 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk"/>
Nov 08 15:29:02 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:29:02 user nova-compute[74788]:     </disk>
Nov 08 15:29:02 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:29:02 user nova-compute[74788]:       <mac address="fa:16:3e:b5:84:2f"/>
Nov 08 15:29:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:29:02 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:29:02 user nova-compute[74788]:       <target dev="tap5b2757df-fa"/>
Nov 08 15:29:02 user nova-compute[74788]:     </interface>
Nov 08 15:29:02 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:29:02 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/console.log" append="off"/>
Nov 08 15:29:02 user nova-compute[74788]:     </serial>
Nov 08 15:29:02 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:29:02 user nova-compute[74788]:     <video>
Nov 08 15:29:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:29:02 user nova-compute[74788]:     </video>
Nov 08 15:29:02 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:29:02 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:29:02 user nova-compute[74788]:     </rng>
Nov 08 15:29:02 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:29:02 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:29:02 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:29:02 user nova-compute[74788]:     </memballoon>
Nov 08 15:29:02 user nova-compute[74788]:   </devices>
Nov 08 15:29:02 user nova-compute[74788]: </domain>
Nov 08 15:29:02 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-973903588',display_name='tempest-ServerRescueNegativeTestJSON-server-973903588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-973903588',id=30,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3iVkBxwB1fgnj77Aiv07aPCz6xIpN4Tg3N6BHAMkCNe3ydN1cAAo3lCiJ0k5smk1mIni4gip8wWrqcxJRGL9jCepn1Y9xEZUBrHIcCEhlx9MXIHjMU0DhEHu9j5UYZ5w==',key_name='tempest-keypair-1459817029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-t3yqqs28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:29:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=e824084b-42b2-4833-b14f-958ec30156a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG os_vif [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f378351b-7ce6-5b6c-9c38-90a216262e1d', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2757df-fa, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2757df-fa, col_values=(('qos', UUID('dfbc8997-bbc3-450a-b4c4-7bc97bc678dc')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2757df-fa, col_values=(('external_ids', {'iface-id': '5b2757df-faeb-4fdb-8add-612e784b5195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:84:2f', 'vm-uuid': 'e824084b-42b2-4833-b14f-958ec30156a8'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: INFO os_vif [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa')
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:b5:84:2f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updated VIF entry in instance network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7f7311a7-922e-4955-90fa-34e6d7e8386f req-c990e79c-5021-424a-9b5e-cc60c763895c service nova] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:02 user nova-compute[74788]: INFO nova.compute.manager [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Terminating instance
Nov 08 15:29:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-b646cb7f-71c4-46a6-ba79-794d7cd8e19c req-c6722da6-56b6-45f4-ad96-44318231b8e4 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-unplugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:03 user nova-compute[74788]: WARNING nova.compute.manager [req-fd6c3eb2-d743-49eb-9225-5af095989253 req-584ae0e6-11d4-440c-b605-c1eba4bdaba3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state building and task_state spawning.
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Instance destroyed successfully.
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.objects.instance [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'resources' on Instance uuid 2a33da20-7af4-4d6c-8cba-94cf3986245c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:22:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1217183129',display_name='tempest-ServerActionsTestOtherA-server-2010389919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1217183129',id=23,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWufhC2wNIP82+4rkHQKCig+l/NPvPXlNO42jr6VAlVEH7BsTyfLvjEMVQ37qzRyZhqy4uKZaCUtOKHYXL2gbtqATzewteMKhd4fqlhf27QjZ0MNk4u4aBZ487ITolCeA==',key_name='tempest-keypair-1020138111',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-unj5a1bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:25:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=2a33da20-7af4-4d6c-8cba-94cf3986245c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "address": "fa:16:3e:24:b6:f0", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451bdddb-f4", "ovs_interfaceid": "451bdddb-f4ef-4f81-8c6f-1a087a7cf116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG os_vif [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451bdddb-f4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e28145dd-fd35-47d0-b417-bd618d3f7f1c) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:29:04 user nova-compute[74788]: INFO os_vif [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b6:f0,bridge_name='br-int',has_traffic_filtering=True,id=451bdddb-f4ef-4f81-8c6f-1a087a7cf116,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451bdddb-f4')
Nov 08 15:29:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Deleting instance files /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c_del
Nov 08 15:29:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Deletion of /opt/stack/data/nova/instances/2a33da20-7af4-4d6c-8cba-94cf3986245c_del complete
Nov 08 15:29:04 user nova-compute[74788]: INFO nova.compute.manager [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 08 15:29:04 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:29:04 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:05 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Took 1.01 seconds to deallocate network for instance.
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] Acquiring lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] No waiting events found dispatching network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:05 user nova-compute[74788]: WARNING nova.compute.manager [req-2e1ccd19-ac8f-4585-bd6d-88d020334266 req-dbefeebc-ffdf-4bbe-8d95-6cb0bb5792f7 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received unexpected event network-vif-plugged-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 for instance with vm_state deleted and task_state None.
Nov 08 15:29:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:05 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Deleted allocations for instance 2a33da20-7af4-4d6c-8cba-94cf3986245c
Nov 08 15:29:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-29f02ebf-0db2-4ef6-a5c7-6ec85ddb8569 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "2a33da20-7af4-4d6c-8cba-94cf3986245c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:06 user nova-compute[74788]: WARNING nova.compute.manager [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state building and task_state spawning.
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb7e7e3f-618a-4586-b128-68f3bd39dacb req-9bb154d3-fccc-4683-b1a5-2273d669b451 service nova] [instance: 2a33da20-7af4-4d6c-8cba-94cf3986245c] Received event network-vif-deleted-451bdddb-f4ef-4f81-8c6f-1a087a7cf116 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:29:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance spawned successfully.
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:06 user nova-compute[74788]: INFO nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 08 15:29:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:29:06 user nova-compute[74788]: INFO nova.compute.manager [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Took 7.64 seconds to build instance.
Nov 08 15:29:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-57b65981-12e7-43f6-aa6b-7104a5179d16 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.785s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:29:14 user nova-compute[74788]: INFO nova.compute.claims [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Claim successful on node user
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:29:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.policy [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bda1bc3f1fb4a1fa548a478724c28b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e024f79d64fe4a7da3cbdced0d861c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:29:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Creating image(s)
Nov 08 15:29:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "/opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "/opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk 1073741824" returned: 0 in 0.049s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Successfully created port: 76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Cannot resize image /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Ensure instance console log exists: /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Successfully updated port: 76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquired lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-changed-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Refreshing instance network info cache due to event network-changed-76645b1b-f388-4bef-9268-24fe0f9a9636. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] Acquiring lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updating instance_info_cache with network_info: [{"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Releasing lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Instance network_info: |[{"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] Acquired lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Refreshing network info cache for port 76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Start _get_guest_xml network_info=[{"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:29:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1415982',id=31,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFANaJZ45AD8phoCw7Oq052RVj0IfzpKaDWCvtZDCpIfGNb1fEqRYqO1ngEv+CE4Rmc9rjiA8sxMu1HOkIyL8qT1h1J6p957p52Nm8/ptLaH+XhFxGfhO6n5ZCZQLeuhA==',key_name='tempest-keypair-1844452545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e024f79d64fe4a7da3cbdced0d861c70',ramdisk_id='',reservation_id='r-7rtidgq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bda1bc3f1fb4a1fa548a478724c28b1',uuid=d4101406-2672-44ee-8db3-2be2e1495a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converting VIF {"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lazy-loading 'pci_devices' on Instance uuid d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:29:17 user nova-compute[74788]:   <uuid>d4101406-2672-44ee-8db3-2be2e1495a93</uuid>
Nov 08 15:29:17 user nova-compute[74788]:   <name>instance-0000001f</name>
Nov 08 15:29:17 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:29:17 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:29:17 user nova-compute[74788]:   <metadata>
Nov 08 15:29:17 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:29:17 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270</nova:name>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:29:17</nova:creationTime>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:29:17 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:29:17 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:owner>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:user uuid="4bda1bc3f1fb4a1fa548a478724c28b1">tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member</nova:user>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:project uuid="e024f79d64fe4a7da3cbdced0d861c70">tempest-TestServerVolumeAttachScenarioOldVersion-1327018243</nova:project>
Nov 08 15:29:17 user nova-compute[74788]:       </nova:owner>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:29:17 user nova-compute[74788]:       <nova:ports>
Nov 08 15:29:17 user nova-compute[74788]:         <nova:port uuid="76645b1b-f388-4bef-9268-24fe0f9a9636">
Nov 08 15:29:17 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:29:17 user nova-compute[74788]:         </nova:port>
Nov 08 15:29:17 user nova-compute[74788]:       </nova:ports>
Nov 08 15:29:17 user nova-compute[74788]:     </nova:instance>
Nov 08 15:29:17 user nova-compute[74788]:   </metadata>
Nov 08 15:29:17 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:29:17 user nova-compute[74788]:     <system>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="serial">d4101406-2672-44ee-8db3-2be2e1495a93</entry>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="uuid">d4101406-2672-44ee-8db3-2be2e1495a93</entry>
Nov 08 15:29:17 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:29:17 user nova-compute[74788]:     </system>
Nov 08 15:29:17 user nova-compute[74788]:   </sysinfo>
Nov 08 15:29:17 user nova-compute[74788]:   <os>
Nov 08 15:29:17 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:29:17 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:29:17 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:29:17 user nova-compute[74788]:   </os>
Nov 08 15:29:17 user nova-compute[74788]:   <features>
Nov 08 15:29:17 user nova-compute[74788]:     <acpi/>
Nov 08 15:29:17 user nova-compute[74788]:     <apic/>
Nov 08 15:29:17 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:29:17 user nova-compute[74788]:   </features>
Nov 08 15:29:17 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:29:17 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:29:17 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:29:17 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:29:17 user nova-compute[74788]:   </clock>
Nov 08 15:29:17 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:29:17 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:29:17 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:29:17 user nova-compute[74788]:   </cpu>
Nov 08 15:29:17 user nova-compute[74788]:   <devices>
Nov 08 15:29:17 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:29:17 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:29:17 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk"/>
Nov 08 15:29:17 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:29:17 user nova-compute[74788]:     </disk>
Nov 08 15:29:17 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:29:17 user nova-compute[74788]:       <mac address="fa:16:3e:9a:cc:fc"/>
Nov 08 15:29:17 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:29:17 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:29:17 user nova-compute[74788]:       <target dev="tap76645b1b-f3"/>
Nov 08 15:29:17 user nova-compute[74788]:     </interface>
Nov 08 15:29:17 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:29:17 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/console.log" append="off"/>
Nov 08 15:29:17 user nova-compute[74788]:     </serial>
Nov 08 15:29:17 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:29:17 user nova-compute[74788]:     <video>
Nov 08 15:29:17 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:29:17 user nova-compute[74788]:     </video>
Nov 08 15:29:17 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:29:17 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:29:17 user nova-compute[74788]:     </rng>
Nov 08 15:29:17 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:29:17 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:29:17 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:29:17 user nova-compute[74788]:     </memballoon>
Nov 08 15:29:17 user nova-compute[74788]:   </devices>
Nov 08 15:29:17 user nova-compute[74788]: </domain>
Nov 08 15:29:17 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1415982',id=31,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFANaJZ45AD8phoCw7Oq052RVj0IfzpKaDWCvtZDCpIfGNb1fEqRYqO1ngEv+CE4Rmc9rjiA8sxMu1HOkIyL8qT1h1J6p957p52Nm8/ptLaH+XhFxGfhO6n5ZCZQLeuhA==',key_name='tempest-keypair-1844452545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e024f79d64fe4a7da3cbdced0d861c70',ramdisk_id='',reservation_id='r-7rtidgq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bda1bc3f1fb4a1fa548a478724c28b1',uuid=d4101406-2672-44ee-8db3-2be2e1495a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converting VIF {"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG os_vif [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '188746eb-df1d-57d9-be3f-ec6cc3587cb9', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76645b1b-f3, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76645b1b-f3, col_values=(('qos', UUID('4941003b-c6d1-48f2-b66c-535d80820ce5')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76645b1b-f3, col_values=(('external_ids', {'iface-id': '76645b1b-f388-4bef-9268-24fe0f9a9636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:cc:fc', 'vm-uuid': 'd4101406-2672-44ee-8db3-2be2e1495a93'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:17 user nova-compute[74788]: INFO os_vif [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3')
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] No VIF found with MAC fa:16:3e:9a:cc:fc, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:29:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updated VIF entry in instance network info cache for port 76645b1b-f388-4bef-9268-24fe0f9a9636. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:29:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updating instance_info_cache with network_info: [{"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2cbeb7c1-7b1e-4b12-a045-1d1845909340 req-9b37a8c2-0b5b-463c-a759-f1950692ae1a service nova] Releasing lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] No waiting events found dispatching network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:19 user nova-compute[74788]: WARNING nova.compute.manager [req-77338e0a-8e81-47a9-ab18-74c6790462ab req-8fa59f24-a6af-400e-85d0-ad2e0ab6fb4e service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received unexpected event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 for instance with vm_state building and task_state spawning.
Nov 08 15:29:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] No waiting events found dispatching network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:29:21 user nova-compute[74788]: WARNING nova.compute.manager [req-12b1d48e-14c0-43b2-b9b7-2e41deed6e16 req-54194a2e-2d79-4d9c-84e5-1ea3ae6719b2 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received unexpected event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 for instance with vm_state building and task_state spawning.
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:29:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Instance spawned successfully.
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:29:21 user nova-compute[74788]: INFO nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 08 15:29:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:29:21 user nova-compute[74788]: INFO nova.compute.manager [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Took 6.96 seconds to build instance.
Nov 08 15:29:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ddce65f1-ab0e-4a26-b9a8-1cfacdf7b805 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.062s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:37 user nova-compute[74788]: INFO nova.compute.manager [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Detaching volume 0ec3453c-8438-4769-b887-068d1cd7bb15
Nov 08 15:29:37 user nova-compute[74788]: INFO nova.virt.block_device [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Attempting to driver detach volume 0ec3453c-8438-4769-b887-068d1cd7bb15 from mountpoint /dev/vdb
Nov 08 15:29:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Attempting to detach device vdb from instance 04fede4a-9cd5-4386-a083-b25334ebbd03 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:29:37 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:29:37 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:29:37 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:29:37 user nova-compute[74788]:   <serial>0ec3453c-8438-4769-b887-068d1cd7bb15</serial>
Nov 08 15:29:37 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:29:37 user nova-compute[74788]: </disk>
Nov 08 15:29:37 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:29:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully detached device vdb from instance 04fede4a-9cd5-4386-a083-b25334ebbd03 from the persistent domain config.
Nov 08 15:29:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04fede4a-9cd5-4386-a083-b25334ebbd03 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:29:37 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:29:37 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:29:37 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:29:37 user nova-compute[74788]:   <serial>0ec3453c-8438-4769-b887-068d1cd7bb15</serial>
Nov 08 15:29:37 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:29:37 user nova-compute[74788]: </disk>
Nov 08 15:29:37 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:29:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:43 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.16286849975586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 04fede4a-9cd5-4386-a083-b25334ebbd03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d4101406-2672-44ee-8db3-2be2e1495a93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:29:48 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:29:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:29:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:29:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:29:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:29:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing instance network info cache due to event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:57 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 04fede4a-9cd5-4386-a083-b25334ebbd03 is timed out.
Nov 08 15:29:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully detached device vdb from instance 04fede4a-9cd5-4386-a083-b25334ebbd03 from the live domain config.
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDVvdsHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:29:57 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1458e217-3ee7-4f8a-8780-9e751ea73306]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:29:57 user nova-compute[74788]: No targets found.
Nov 08 15:29:57 user nova-compute[74788]: iSNS:
Nov 08 15:29:57 user nova-compute[74788]: No targets found.
Nov 08 15:29:57 user nova-compute[74788]: STATIC:
Nov 08 15:29:57 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15
Nov 08 15:29:57 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:29:57 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:29:57 user nova-compute[74788]: FIRMWARE:
Nov 08 15:29:57 user nova-compute[74788]: No targets found.
Nov 08 15:29:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:29:57 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:29:57 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updated VIF entry in instance network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[971062a6-8016-4733-9bf2-ff020035b2d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-16021de3-3c36-43e8-96d5-2894b7969860 req-153dbbd7-0216-4887-93b3-42ae17f43fcf service nova] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33294e7-aaa7-4b4a-b77f-f5d2a63c49b9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:29:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 (non-flash)
Nov 08 15:29:57 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f778c1f5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac6aab-9320-435b-a640-1f546c42ad46]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e123f8c-c62f-4112-b139-b35be08e8f24]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ecffa-bc98-47b3-8e4c-1ac29a8b91bf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e67e8-6526-44b0-a302-fda372d2db4c]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1621ad-1dfc-4d54-af6d-b2098f5207bd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ecf950-9f60-44ab-b5cd-ed7893792688]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260]
Nov 08 15:29:58 user nova-compute[74788]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15, portal: 172.16.0.220,3260] successful.
Nov 08 15:29:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec3453c-8438-4769-b887-068d1cd7bb15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bed49b-d7c1-4f05-96d0-8f7dc2a42440]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] <== disconnect_volume: return (313ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:29:58 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:29:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'flavor' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:29:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a6e5e54-bf0e-4ff8-b9ea-47657dba2cb4 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:05 user nova-compute[74788]: INFO nova.compute.manager [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Shelving
Nov 08 15:30:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:05 user nova-compute[74788]: WARNING nova.compute.manager [req-9761a5a4-1ae2-4c27-8131-d1c649bd124e req-c3a29a9c-e251-48be-bec2-40da16c15f1c service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state active and task_state shelving.
Nov 08 15:30:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance destroyed successfully.
Nov 08 15:30:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Beginning cold snapshot process
Nov 08 15:30:06 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:30:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk /opt/stack/data/nova/instances/snapshots/tmpvxnwgwfx/75764d3ebf274a35885bf82bc514c419 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk /opt/stack/data/nova/instances/snapshots/tmpvxnwgwfx/75764d3ebf274a35885bf82bc514c419" returned: 0 in 0.671s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Snapshot extracted, beginning image upload
Nov 08 15:30:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:08 user nova-compute[74788]: WARNING nova.compute.manager [req-b43e7526-807c-4889-aba2-b5a4efe2d30b req-8973179e-2a3a-4908-bd27-0c31973daef7 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 15:30:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Snapshot image upload complete
Nov 08 15:30:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:30:10 user nova-compute[74788]: INFO nova.compute.manager [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Shelve offloading
Nov 08 15:30:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance destroyed successfully.
Nov 08 15:30:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:30:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:30:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:30:10 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.compute.manager [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Terminating instance
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-unplugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] No waiting events found dispatching network-vif-unplugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c54114d-2b80-46eb-99f3-d67d6d13029f req-be809cae-8a53-40ef-87bb-d6e744231c10 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-unplugged-e81cab14-cae2-4400-8807-1fa7237e48f0 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Instance destroyed successfully.
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.objects.instance [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lazy-loading 'resources' on Instance uuid 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:24:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1089820039',display_name='tempest-TestMinimumBasicScenario-server-1089820039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1089820039',id=27,image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7TqweftpvGTxFNMGY2p7J/kpntHS0bnECu8BSKlj3tRxtCH/m4ubz1lvkhly2e1/752oizHMM2ltDw6dO+diYUA4SAPK2y2zuk8IWkGDyNR4D76Bqzv9XoBgQttZWkZg==',key_name='tempest-TestMinimumBasicScenario-2003992408',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:24:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f737b11a8d4a88b798295956c0c41f',ramdisk_id='',reservation_id='r-0k0qclfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ffcc8f3a-bdd3-4b06-ae94-e9823a77822d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-181050692',owner_user_name='tempest-TestMinimumBasicScenario-181050692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:24:38Z,user_data=None,user_id='4c06d28d62994d15b3a91c5d210eea4f',uuid=99d02fc1-e7f7-4ab7-91a9-7eb738e60da8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converting VIF {"id": "e81cab14-cae2-4400-8807-1fa7237e48f0", "address": "fa:16:3e:10:29:77", "network": {"id": "1de64095-c89e-4a14-a958-6d0ef82bef34", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1677852053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f737b11a8d4a88b798295956c0c41f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape81cab14-ca", "ovs_interfaceid": "e81cab14-cae2-4400-8807-1fa7237e48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG os_vif [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape81cab14-ca, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=714a3958-736c-4dc6-b2f6-e6ef580b84ab) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: INFO os_vif [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:29:77,bridge_name='br-int',has_traffic_filtering=True,id=e81cab14-cae2-4400-8807-1fa7237e48f0,network=Network(1de64095-c89e-4a14-a958-6d0ef82bef34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape81cab14-ca')
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Deleting instance files /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8_del
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Deletion of /opt/stack/data/nova/instances/99d02fc1-e7f7-4ab7-91a9-7eb738e60da8_del complete
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.compute.manager [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance destroyed successfully.
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'resources' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCibB0yyuXrZ3CTeTiEDSDGlXqipDK/7qt+NPNltQbiMhjo3HOgAuZjwgreV+rXAqbrWxXpu+KpCW3T6x19pDexYVxbVSzsKIhiWO3Gz+OKpQ8VFtRoI9lphje7yL6ODw==',key_name='tempest-keypair-156181796',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:30:10.613678',shelved_host='user',shelved_image_id='0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG os_vif [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07e83f52-b0, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72b42e64-d8a8-44dd-b68c-6c2056aecaae) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing instance network info cache due to event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:30:11 user nova-compute[74788]: DEBUG nova.network.neutron [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:30:11 user nova-compute[74788]: INFO os_vif [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0')
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Deleting instance files /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6_del
Nov 08 15:30:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Deletion of /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6_del complete
Nov 08 15:30:12 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Deleted allocations for instance e162d6d0-3c7d-4b87-8b39-09c17d2fadb6
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'numa_topology' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.objects.base [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<e162d6d0-3c7d-4b87-8b39-09c17d2fadb6> lazy-loaded attributes: resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.network.neutron [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updated VIF entry in instance network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.network.neutron [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap07e83f52-b0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-07952a7c-813e-4600-86fa-a1f9ab32c9ef req-3761751e-7173-44c5-9ae7-6f3f6d21d3f0 service nova] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:30:12 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Took 0.68 seconds to deallocate network for instance.
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0b057bc6-ef1d-4ecf-95fa-4eead2131138 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.054s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:30:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:12 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Deleted allocations for instance 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8
Nov 08 15:30:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-98eaae98-a187-40b5-81b3-78d00c4c26a4 tempest-TestMinimumBasicScenario-181050692 tempest-TestMinimumBasicScenario-181050692-project-member] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] Acquiring lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] Lock "99d02fc1-e7f7-4ab7-91a9-7eb738e60da8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] No waiting events found dispatching network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:13 user nova-compute[74788]: WARNING nova.compute.manager [req-a2c9e8ce-0fab-4b58-87aa-9998ecd364d9 req-667c406b-263b-48fc-ae24-57af126d9aa6 service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received unexpected event network-vif-plugged-e81cab14-cae2-4400-8807-1fa7237e48f0 for instance with vm_state deleted and task_state None.
Nov 08 15:30:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-4ede2a1a-1559-4656-8987-de2d4076c6e8 req-53de609f-0b6c-4dd9-816b-89a16beb09aa service nova] [instance: 99d02fc1-e7f7-4ab7-91a9-7eb738e60da8] Received event network-vif-deleted-e81cab14-cae2-4400-8807-1fa7237e48f0 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:30:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing instance network info cache due to event network-changed-e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] Acquiring lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] Acquired lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Refreshing network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:22 user nova-compute[74788]: INFO nova.compute.manager [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Terminating instance
Nov 08 15:30:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-unplugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] No waiting events found dispatching network-vif-unplugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-904217b1-fd78-46ad-b0c8-0c972fe39d42 req-23a1b65f-2f18-4771-be70-7047e71b37fb service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-unplugged-e864e81d-d297-4d94-b65f-e445aff7c3bc for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updated VIF entry in instance network info cache for port e864e81d-d297-4d94-b65f-e445aff7c3bc. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [{"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9bfa5594-51dc-4bb6-a953-5e5ac2990717 req-381c6df0-9277-4de3-a529-1f29f0d2cec1 service nova] Releasing lock "refresh_cache-ce357a1e-6baf-4309-8227-6b2c77d2bfe6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:30:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Instance destroyed successfully.
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lazy-loading 'resources' on Instance uuid ce357a1e-6baf-4309-8227-6b2c77d2bfe6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-725645277',display_name='tempest-TestStampPattern-server-725645277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-725645277',id=22,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcBJpqlhTgkJ9o4b29FvgvtdKUWAReBedTLPijek5LjCsa0SpRRyqsDy9ceEXRoAj8kLQ0ugXFxYiXJS8cTe65H7a4WIDEQ0N6/Hegn1jTOW8LlW9zXcYDYrxrgpUZ+SA==',key_name='tempest-TestStampPattern-1282280225',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:21:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef2ea0f041204b63b39a09e275b340cc',ramdisk_id='',reservation_id='r-gxkq2obd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-242603636',owner_user_name='tempest-TestStampPattern-242603636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:25:07Z,user_data=None,user_id='4568bc1060d24fceba63059e683444bd',uuid=ce357a1e-6baf-4309-8227-6b2c77d2bfe6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converting VIF {"id": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "address": "fa:16:3e:f1:7d:51", "network": {"id": "1b82bccf-17ff-4f1f-a215-1c4af7cf24c8", "bridge": "br-int", "label": "tempest-TestStampPattern-1688660852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2ea0f041204b63b39a09e275b340cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape864e81d-d2", "ovs_interfaceid": "e864e81d-d297-4d94-b65f-e445aff7c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG os_vif [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape864e81d-d2, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3552df9-88f1-4e78-80de-1f94ceec41c6) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:23 user nova-compute[74788]: INFO os_vif [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=e864e81d-d297-4d94-b65f-e445aff7c3bc,network=Network(1b82bccf-17ff-4f1f-a215-1c4af7cf24c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape864e81d-d2')
Nov 08 15:30:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Deleting instance files /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6_del
Nov 08 15:30:23 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Deletion of /opt/stack/data/nova/instances/ce357a1e-6baf-4309-8227-6b2c77d2bfe6_del complete
Nov 08 15:30:23 user nova-compute[74788]: INFO nova.compute.manager [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 15:30:23 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:30:23 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:23 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Took 0.51 seconds to deallocate network for instance.
Nov 08 15:30:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:24 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:30:24 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:30:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:24 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Deleted allocations for instance ce357a1e-6baf-4309-8227-6b2c77d2bfe6
Nov 08 15:30:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37f45563-b72d-4a54-83af-22a6cd057ac9 tempest-TestStampPattern-242603636 tempest-TestStampPattern-242603636-project-member] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:24 user nova-compute[74788]: DEBUG nova.compute.manager [req-b97ea03b-6a85-4981-8c31-024dfcc185b9 req-f8758f97-8d0d-4aeb-813d-e37a3ba27013 service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-deleted-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] Acquiring lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] Lock "ce357a1e-6baf-4309-8227-6b2c77d2bfe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] No waiting events found dispatching network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:25 user nova-compute[74788]: WARNING nova.compute.manager [req-3950ffc0-f3f4-4b92-8332-a3fc2f888569 req-233231af-8c79-4072-a88d-124bf2e75dbf service nova] [instance: ce357a1e-6baf-4309-8227-6b2c77d2bfe6] Received unexpected event network-vif-plugged-e864e81d-d297-4d94-b65f-e445aff7c3bc for instance with vm_state deleted and task_state None.
Nov 08 15:30:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:27 user nova-compute[74788]: INFO nova.compute.manager [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Terminating instance
Nov 08 15:30:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-unplugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] No waiting events found dispatching network-vif-unplugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-54ef1dc0-e1a4-4778-a689-1cb22f790d5c req-ac293a68-989d-44c4-9901-624ee7260aad service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-unplugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Instance destroyed successfully.
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.objects.instance [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lazy-loading 'resources' on Instance uuid 04fede4a-9cd5-4386-a083-b25334ebbd03 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-876919619',display_name='tempest-AttachVolumeTestJSON-server-876919619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-876919619',id=25,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD9reh/BHnCemFz65SIHPquEQDrk0bx1TKLZcsO2x0uj/t86CpK/o5H6Drn+KCf0C/Bv0sObPJRxd84bCaJLQA95UDRGjk91uhtko7gx/H8pyzciVzRS5YPx6nTfzYS9w==',key_name='tempest-keypair-1685087599',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:23:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7984a5e14b104fdbbe50c0171702b765',ramdisk_id='',reservation_id='r-vsf0ele7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1302335670',owner_user_name='tempest-AttachVolumeTestJSON-1302335670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='649a41ab82754c269c03606c18428b86',uuid=04fede4a-9cd5-4386-a083-b25334ebbd03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converting VIF {"id": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "address": "fa:16:3e:fc:6b:fd", "network": {"id": "5f7647bb-f4c7-4798-a180-d1e8ec81be79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1859155754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7984a5e14b104fdbbe50c0171702b765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9942c8e9-6b", "ovs_interfaceid": "9942c8e9-6b88-49e6-878e-7d4d0b0db18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG os_vif [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9942c8e9-6b, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdd155a8-9332-4910-9e3d-28fb142d1230) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:28 user nova-compute[74788]: INFO os_vif [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:6b:fd,bridge_name='br-int',has_traffic_filtering=True,id=9942c8e9-6b88-49e6-878e-7d4d0b0db18f,network=Network(5f7647bb-f4c7-4798-a180-d1e8ec81be79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9942c8e9-6b')
Nov 08 15:30:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Deleting instance files /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03_del
Nov 08 15:30:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Deletion of /opt/stack/data/nova/instances/04fede4a-9cd5-4386-a083-b25334ebbd03_del complete
Nov 08 15:30:28 user nova-compute[74788]: INFO nova.compute.manager [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 15:30:28 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:30:28 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:29 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Took 0.76 seconds to deallocate network for instance.
Nov 08 15:30:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-15202062-8d02-4017-8756-4a36ce59e176 req-ab7896e4-63f5-4317-9efe-aee6f85329a4 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-deleted-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:30:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:29 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Deleted allocations for instance 04fede4a-9cd5-4386-a083-b25334ebbd03
Nov 08 15:30:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-40057c2a-9956-4dc5-b593-1451828d1b72 tempest-AttachVolumeTestJSON-1302335670 tempest-AttachVolumeTestJSON-1302335670-project-member] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] Acquiring lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] Lock "04fede4a-9cd5-4386-a083-b25334ebbd03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] No waiting events found dispatching network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:30:30 user nova-compute[74788]: WARNING nova.compute.manager [req-c9aa8f79-1402-4252-8862-4e7b055e65d5 req-6305bda2-7538-4d60-8a7f-f4b85dd29621 service nova] [instance: 04fede4a-9cd5-4386-a083-b25334ebbd03] Received unexpected event network-vif-plugged-9942c8e9-6b88-49e6-878e-7d4d0b0db18f for instance with vm_state deleted and task_state None.
Nov 08 15:30:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:30:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:43 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:44 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:45 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:47 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:30:47 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8284MB free_disk=25.303165435791016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d4101406-2672-44ee-8db3-2be2e1495a93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:30:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing instance network info cache due to event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'flavor' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:30:49 user nova-compute[74788]: INFO nova.compute.manager [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Attaching volume fa01f789-444d-4180-ad71-41be44840d57 to /dev/vdb
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updated VIF entry in instance network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG nova.network.neutron [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d46273d7-bd85-405b-a2b6-4983a475e0f7 req-1d4c31b6-67a9-4a8b-86a1-6e55611667a3 service nova] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG os_brick.utils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9044c5-d2c7-4324-bf9f-f598c970f59a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b2a2f-eb6d-45a4-9d37-2eaeb5af0f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[920ebc88-ca58-4e61-b28d-279cac93f0f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[87882866-c992-4043-81e1-6b8717d0bc16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:30:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:30:50 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:30:50 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f8ab55-46d3-48c0-bf30-96abea0b33bc]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG os_brick.utils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating existing volume attachment record: 6de51a30-e159-4445-b32c-b03c58c5969f {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:30:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:30:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:30:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:30:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-changed-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Refreshing instance network info cache due to event network-changed-76645b1b-f388-4bef-9268-24fe0f9a9636. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] Acquiring lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] Acquired lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:31:05 user nova-compute[74788]: DEBUG nova.network.neutron [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Refreshing network info cache for port 76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:31:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updated VIF entry in instance network info cache for port 76645b1b-f388-4bef-9268-24fe0f9a9636. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:31:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updating instance_info_cache with network_info: [{"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:31:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f249de0c-ac64-49dc-bdb7-09fb804c4619 req-a23721e6-488a-4bc6-89e7-48c6146f4d96 service nova] Releasing lock "refresh_cache-d4101406-2672-44ee-8db3-2be2e1495a93" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:31:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lazy-loading 'flavor' on Instance uuid d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:12 user nova-compute[74788]: INFO nova.compute.manager [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Attaching volume 9ba5c711-f27a-4c21-b115-38c1ad51df1a to /dev/vdb
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.utils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fba25a-adb9-43dc-8fe5-5173d28687d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23128a5a-39d5-4e56-8346-a4142e550c3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c97cc-c06b-491c-bcf6-a2e5af7b9058]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bab35-201e-4e8b-af89-aca5b621af50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:31:12 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:31:12 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b9f454-2933-4ab5-adfc-192b98d8d624]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG os_brick.utils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:31:12 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updating existing volume attachment record: 98316356-3b47-4428-93d8-4da167f27189 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:31:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBTLXlwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:31:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:31:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:31:14 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ebc67-ce84-4e6e-bb22-933376f25731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:31:14 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7287905-7ff8-480f-bd3c-a09b1e2d7ec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57] added
Nov 08 15:31:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abc3a17-3e61-4d65-953c-3609b01110cf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e27aec-654b-4c38-a9ea-2d8d8076ef09]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBTLXlwi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBTLXlwi" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[21256c9f-e366-4cad-b56d-dc1c8a1e4270]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBTLXlwi'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96afbcd9-154f-4772-b1fd-92b0004215bf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98be181-052f-464c-a2d1-1669e684a6bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:31:14 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:31:14 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:31:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:31:14 user nova-compute[74788]: 
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64c5d0-362a-415f-8317-1ccc3185c210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260]
Nov 08 15:31:14 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260] successful.
Nov 08 15:31:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0eef23-a0f0-46ac-ae43-b437d949cd4f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a108fbf-8a3f-4c10-9472-b4d453fccda8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:31:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:31:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7c518-14c3-4c1e-b0c8-3e141b648b49]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBTLXlwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:31:14 user nova-compute[74788]: INFO nova.compute.claims [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Claim successful on node user
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:31:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:31:15 user nova-compute[74788]: INFO nova.virt.block_device [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Booting with volume 734aae35-4d1a-45a5-bf01-1d5198410a4e at /dev/vda
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.policy [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30bfaf63a8bf4172b0a72ee8536a76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c097c366f91c496e9f5a4cfaff0e14c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.utils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d1af11-4c68-444d-a16a-63307865f671]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16ea64-5c72-46e9-9a9f-378a9fe19da3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c85ec-447b-4fd3-8c44-ed6845c0cb5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911d589-b549-44cc-a937-109cbf7f149b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:31:15 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:31:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[df29ffb7-9442-40cf-bf4a-16c30eb8b055]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.utils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating existing volume attachment record: 17676620-6a2b-4cf9-8c2b-08aa63d0d2fa {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23131393630626630', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131393630626630', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'flavor' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:31:15 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:31:15 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:31:15 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:31:15 user nova-compute[74788]:   <serial>fa01f789-444d-4180-ad71-41be44840d57</serial>
Nov 08 15:31:15 user nova-compute[74788]: </disk>
Nov 08 15:31:15 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:31:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:31:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:31:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:b5:84:2f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:31:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0bfd58ef-82c2-42bb-9d83-153196f0c7a0 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.547s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Successfully created port: 8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:31:17 user nova-compute[74788]: INFO nova.compute.manager [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Rescuing
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Successfully updated port: 8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-changed-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Refreshing instance network info cache due to event network-changed-8a40c838-2845-4846-a1b9-c39fc25d8044. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance network_info: |[{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Refreshing network info cache for port 8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updated VIF entry in instance network info cache for port 8a40c838-2845-4846-a1b9-c39fc25d8044. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2749ddf2-f00d-48d4-96e6-0cddf4a221b5 req-afb39ee8-5788-44fe-91c9-b9a0e5c6c40f service nova] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance destroyed successfully.
Nov 08 15:31:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Attempting rescue
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:31:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Creating image(s)
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'trusted_certs' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue" returned: 0 in 0.062s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:18 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'migration_context' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.base [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<e824084b-42b2-4833-b14f-958ec30156a8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start _get_guest_xml network_info=[{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:b5:84:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04773e08-e579-43f8-a159-498093451850', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.base [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<e824084b-42b2-4833-b14f-958ec30156a8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'numa_topology' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.base [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<e824084b-42b2-4833-b14f-958ec30156a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:31:19 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:31:19 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'vcpu_model' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.base [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<e824084b-42b2-4833-b14f-958ec30156a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-973903588',display_name='tempest-ServerRescueNegativeTestJSON-server-973903588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-973903588',id=30,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3iVkBxwB1fgnj77Aiv07aPCz6xIpN4Tg3N6BHAMkCNe3ydN1cAAo3lCiJ0k5smk1mIni4gip8wWrqcxJRGL9jCepn1Y9xEZUBrHIcCEhlx9MXIHjMU0DhEHu9j5UYZ5w==',key_name='tempest-keypair-1459817029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-t3yqqs28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=e824084b-42b2-4833-b14f-958ec30156a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:b5:84:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "vif_mac": "fa:16:3e:b5:84:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'pci_devices' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.objects.base [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Object Instance<e824084b-42b2-4833-b14f-958ec30156a8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:31:19 user nova-compute[74788]:   <uuid>e824084b-42b2-4833-b14f-958ec30156a8</uuid>
Nov 08 15:31:19 user nova-compute[74788]:   <name>instance-0000001e</name>
Nov 08 15:31:19 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:31:19 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:31:19 user nova-compute[74788]:   <metadata>
Nov 08 15:31:19 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:31:19 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-973903588</nova:name>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:31:19</nova:creationTime>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:31:19 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:31:19 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:owner>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:user uuid="dfd067f5d7d64fd38a5599a0cf4db51a">tempest-ServerRescueNegativeTestJSON-423963337-project-member</nova:user>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:project uuid="95c4a8437a8a4c54bef06408109fca0a">tempest-ServerRescueNegativeTestJSON-423963337</nova:project>
Nov 08 15:31:19 user nova-compute[74788]:       </nova:owner>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:31:19 user nova-compute[74788]:       <nova:ports>
Nov 08 15:31:19 user nova-compute[74788]:         <nova:port uuid="5b2757df-faeb-4fdb-8add-612e784b5195">
Nov 08 15:31:19 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 15:31:19 user nova-compute[74788]:         </nova:port>
Nov 08 15:31:19 user nova-compute[74788]:       </nova:ports>
Nov 08 15:31:19 user nova-compute[74788]:     </nova:instance>
Nov 08 15:31:19 user nova-compute[74788]:   </metadata>
Nov 08 15:31:19 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:31:19 user nova-compute[74788]:     <system>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="serial">e824084b-42b2-4833-b14f-958ec30156a8</entry>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="uuid">e824084b-42b2-4833-b14f-958ec30156a8</entry>
Nov 08 15:31:19 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:31:19 user nova-compute[74788]:     </system>
Nov 08 15:31:19 user nova-compute[74788]:   </sysinfo>
Nov 08 15:31:19 user nova-compute[74788]:   <os>
Nov 08 15:31:19 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:31:19 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:31:19 user nova-compute[74788]:   </os>
Nov 08 15:31:19 user nova-compute[74788]:   <features>
Nov 08 15:31:19 user nova-compute[74788]:     <acpi/>
Nov 08 15:31:19 user nova-compute[74788]:     <apic/>
Nov 08 15:31:19 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:31:19 user nova-compute[74788]:   </features>
Nov 08 15:31:19 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:31:19 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:31:19 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:31:19 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:31:19 user nova-compute[74788]:   </clock>
Nov 08 15:31:19 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:31:19 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:31:19 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:31:19 user nova-compute[74788]:   </cpu>
Nov 08 15:31:19 user nova-compute[74788]:   <devices>
Nov 08 15:31:19 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:31:19 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:31:19 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue"/>
Nov 08 15:31:19 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:31:19 user nova-compute[74788]:     </disk>
Nov 08 15:31:19 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:31:19 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:31:19 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk"/>
Nov 08 15:31:19 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:31:19 user nova-compute[74788]:     </disk>
Nov 08 15:31:19 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:31:19 user nova-compute[74788]:       <mac address="fa:16:3e:b5:84:2f"/>
Nov 08 15:31:19 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:31:19 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:31:19 user nova-compute[74788]:       <target dev="tap5b2757df-fa"/>
Nov 08 15:31:19 user nova-compute[74788]:     </interface>
Nov 08 15:31:19 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:31:19 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/console.log" append="off"/>
Nov 08 15:31:19 user nova-compute[74788]:     </serial>
Nov 08 15:31:19 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:31:19 user nova-compute[74788]:     <video>
Nov 08 15:31:19 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:31:19 user nova-compute[74788]:     </video>
Nov 08 15:31:19 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:31:19 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:31:19 user nova-compute[74788]:     </rng>
Nov 08 15:31:19 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:31:19 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:31:19 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:31:19 user nova-compute[74788]:     </memballoon>
Nov 08 15:31:19 user nova-compute[74788]:   </devices>
Nov 08 15:31:19 user nova-compute[74788]: </domain>
Nov 08 15:31:19 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:31:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance destroyed successfully.
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] No VIF found with MAC fa:16:3e:b5:84:2f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:31:19 user nova-compute[74788]: WARNING nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state active and task_state rescuing.
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:31:19 user nova-compute[74788]: WARNING nova.compute.manager [req-b6a4e634-c0a6-40ee-a82f-e1c02660aba6 req-01ebbfdc-3b76-4c31-970b-fd6dfe75643b service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state active and task_state rescuing.
Nov 08 15:31:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:31:21 user nova-compute[74788]: WARNING nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state active and task_state rescuing.
Nov 08 15:31:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:31:21 user nova-compute[74788]: WARNING nova.compute.manager [req-5322fbb6-c2fd-45d2-aa89-6111905d9675 req-b31d1624-2a65-4469-bb99-e92b418768c0 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state active and task_state rescuing.
Nov 08 15:31:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f1a02dfb-a960-42ae-a814-ca4f6984fa02 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:31:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:45 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:31:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:31:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Skipping network cache update for instance because it is Building. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:31:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:31:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:31:49 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=25.327533721923828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d4101406-2672-44ee-8db3-2be2e1495a93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:31:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:31:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:31:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:58 user nova-compute[74788]: INFO nova.compute.manager [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Unshelving
Nov 08 15:31:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_requests' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'numa_topology' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:31:58 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:31:58 user nova-compute[74788]: INFO nova.compute.claims [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Claim successful on node user
Nov 08 15:31:59 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:31:59 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:31:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:31:59 user nova-compute[74788]: INFO nova.network.neutron [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing instance network info cache due to event network-changed-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] Acquiring lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:32:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Creating image(s)
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start _get_guest_xml network_info=[{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8c68545-480e-469e-88eb-44a996062ca6', 'attached_at': '', 'detached_at': '', 'volume_id': '734aae35-4d1a-45a5-bf01-1d5198410a4e', 'serial': '734aae35-4d1a-45a5-bf01-1d5198410a4e'}, 'attachment_id': '17676620-6a2b-4cf9-8c2b-08aa63d0d2fa', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:32:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:32:00 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:32:00 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:32:00 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5bc12-9050-4226-923c-be9c1488e30f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:32:00 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c120c1-d84f-4c5e-ab31-ca22f8eae7d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e] added
Nov 08 15:32:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[91718c28-b6a1-4a67-8737-53fa0bdb3379]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[97078d78-efdb-445b-859c-18955300b43b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbyPXZSW {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbyPXZSW" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac72b50-8f96-4690-8b2d-3ce2cbb31828]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbyPXZSW'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5eabb-7c1a-4423-8607-07961fcf40bb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854b7d2-da47-4129-a018-cbd792bb96fb]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:32:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Creating image(s)
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'trusted_certs' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] Acquired lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Refreshing network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG nova.objects.base [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<e162d6d0-3c7d-4b87-8b39-09c17d2fadb6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c611f01-5b42-4e4d-87b3-d0ca9c9333e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]
Nov 08 15:32:00 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.
Nov 08 15:32:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[064332b6-50e4-455a-91cd-a0a4b597d336]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e922ae39-4f9d-4a02-96f7-66f2945c0285]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:01 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:01 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:01 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab9b06-b336-484f-bb97-e0612c05e750]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23863363066343766', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863363066343766', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:31:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'pci_devices' on Instance uuid c8c68545-480e-469e-88eb-44a996062ca6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:32:02 user nova-compute[74788]:   <uuid>c8c68545-480e-469e-88eb-44a996062ca6</uuid>
Nov 08 15:32:02 user nova-compute[74788]:   <name>instance-00000020</name>
Nov 08 15:32:02 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:32:02 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:32:02 user nova-compute[74788]:   <metadata>
Nov 08 15:32:02 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:32:02 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:32:02 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherA-server-23126705</nova:name>
Nov 08 15:32:02 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:32:00</nova:creationTime>
Nov 08 15:32:02 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:32:02 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:32:02 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:32:02 user nova-compute[74788]:       <nova:owner>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:user uuid="30bfaf63a8bf4172b0a72ee8536a76b2">tempest-ServerActionsTestOtherA-27641552-project-member</nova:user>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:project uuid="c097c366f91c496e9f5a4cfaff0e14c6">tempest-ServerActionsTestOtherA-27641552</nova:project>
Nov 08 15:32:02 user nova-compute[74788]:       </nova:owner>
Nov 08 15:32:02 user nova-compute[74788]:       <nova:ports>
Nov 08 15:32:02 user nova-compute[74788]:         <nova:port uuid="8a40c838-2845-4846-a1b9-c39fc25d8044">
Nov 08 15:32:02 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:32:02 user nova-compute[74788]:         </nova:port>
Nov 08 15:32:02 user nova-compute[74788]:       </nova:ports>
Nov 08 15:32:02 user nova-compute[74788]:     </nova:instance>
Nov 08 15:32:02 user nova-compute[74788]:   </metadata>
Nov 08 15:32:02 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:32:02 user nova-compute[74788]:     <system>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="serial">c8c68545-480e-469e-88eb-44a996062ca6</entry>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="uuid">c8c68545-480e-469e-88eb-44a996062ca6</entry>
Nov 08 15:32:02 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:32:02 user nova-compute[74788]:     </system>
Nov 08 15:32:02 user nova-compute[74788]:   </sysinfo>
Nov 08 15:32:02 user nova-compute[74788]:   <os>
Nov 08 15:32:02 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:32:02 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:32:02 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:32:02 user nova-compute[74788]:   </os>
Nov 08 15:32:02 user nova-compute[74788]:   <features>
Nov 08 15:32:02 user nova-compute[74788]:     <acpi/>
Nov 08 15:32:02 user nova-compute[74788]:     <apic/>
Nov 08 15:32:02 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:32:02 user nova-compute[74788]:   </features>
Nov 08 15:32:02 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:32:02 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:32:02 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:32:02 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:32:02 user nova-compute[74788]:   </clock>
Nov 08 15:32:02 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:32:02 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:32:02 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:32:02 user nova-compute[74788]:   </cpu>
Nov 08 15:32:02 user nova-compute[74788]:   <devices>
Nov 08 15:32:02 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:32:02 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:32:02 user nova-compute[74788]:       <source dev="/dev/sdc"/>
Nov 08 15:32:02 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:32:02 user nova-compute[74788]:       <serial>734aae35-4d1a-45a5-bf01-1d5198410a4e</serial>
Nov 08 15:32:02 user nova-compute[74788]:     </disk>
Nov 08 15:32:02 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:32:02 user nova-compute[74788]:       <mac address="fa:16:3e:84:2e:d9"/>
Nov 08 15:32:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:02 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:32:02 user nova-compute[74788]:       <target dev="tap8a40c838-28"/>
Nov 08 15:32:02 user nova-compute[74788]:     </interface>
Nov 08 15:32:02 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:32:02 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6/console.log" append="off"/>
Nov 08 15:32:02 user nova-compute[74788]:     </serial>
Nov 08 15:32:02 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:32:02 user nova-compute[74788]:     <video>
Nov 08 15:32:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:02 user nova-compute[74788]:     </video>
Nov 08 15:32:02 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:32:02 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:32:02 user nova-compute[74788]:     </rng>
Nov 08 15:32:02 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:32:02 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:32:02 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:32:02 user nova-compute[74788]:     </memballoon>
Nov 08 15:32:02 user nova-compute[74788]:   </devices>
Nov 08 15:32:02 user nova-compute[74788]: </domain>
Nov 08 15:32:02 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:31:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG os_vif [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '512fcc81-5c5c-591c-b39c-f0a44a626239', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a40c838-28, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a40c838-28, col_values=(('qos', UUID('6dcb8a4d-6b28-43c4-832d-629fc7d4b50b')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a40c838-28, col_values=(('external_ids', {'iface-id': '8a40c838-2845-4846-a1b9-c39fc25d8044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2e:d9', 'vm-uuid': 'c8c68545-480e-469e-88eb-44a996062ca6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:02 user nova-compute[74788]: INFO os_vif [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28')
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:84:2e:d9, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.part --force-share --output=json" returned: 0 in 0.248s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.virt.images [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] 0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.part /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updated VIF entry in instance network info cache for port 07e83f52-b0ec-4065-a1cf-a1064fa5cbbd. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-19662dd0-7c27-44c7-bdaa-df5783ce5ed6 req-d03b574b-a80e-433b-91a1-9b98438561fa service nova] Releasing lock "refresh_cache-e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.part /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.converted" returned: 0 in 0.406s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6,backing_fmt=raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6,backing_fmt=raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk 1073741824" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "8de221b7bbac3fb1f039a0f3dd35f479989463f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'migration_context' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG nova.objects.base [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<e162d6d0-3c7d-4b87-8b39-09c17d2fadb6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:32:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Rebasing disk image.
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.224s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 -F raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:03 user nova-compute[74788]: WARNING nova.compute.manager [req-fb1659cf-4227-47a7-88cd-31f066a23cea req-04cdb41d-6789-4456-9a73-fe78ebc19d9a service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state building and task_state spawning.
Nov 08 15:32:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJsVZDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:32:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:32:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:32:04 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f102f9-b773-4bab-877d-777ae942851b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:32:04 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2fd79e-7d0d-4251-8dad-1f14c8610e6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a] added
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1847d5-5820-4511-b1cc-48eb70dc572e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0f01b4-0f0e-4991-9393-bb30377bef64]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxJsVZDf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxJsVZDf" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d336074-bbc3-44b4-bc7c-137f96e8f5c1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxJsVZDf'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36f39d-21ae-4fdb-adde-1a1d455d8beb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5e2529-9b81-45c7-9fe0-af3c80a2a67d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a160346-e46c-4e4a-9baf-8f822e7c9346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260]
Nov 08 15:32:04 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260] successful.
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[587eeb66-c039-4569-bda4-8be18d0ce5e8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[502dbe55-5228-48d8-b837-bcf77f332c09]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:04 user nova-compute[74788]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)
Nov 08 15:32:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc601767-9b03-441e-b549-cd6da564d607]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:32:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJsVZDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:05 user nova-compute[74788]: WARNING nova.compute.manager [req-71dfd02b-8bf4-4581-b29a-85d69b088914 req-495e455a-6fdd-4d66-8b51-5f18c5896ef0 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state building and task_state spawning.
Nov 08 15:32:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23862333934393830', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862333934393830', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:32:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lazy-loading 'flavor' on Instance uuid d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:32:06 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:32:06 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:32:06 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:32:06 user nova-compute[74788]:   <serial>9ba5c711-f27a-4c21-b115-38c1ad51df1a</serial>
Nov 08 15:32:06 user nova-compute[74788]: </disk>
Nov 08 15:32:06 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 -F raw /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk" returned: 0 in 2.528s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Ensure instance console log exists: /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start _get_guest_xml network_info=[{"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='03c769e7084c4720fefbe627da195b8d',container_format='bare',created_at=2023-11-08T15:30:06Z,direct_url=<?>,disk_format='qcow2',id=0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-671099388-shelved',owner='6fac0333dca24d81b8127258c41a3145',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:30:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:32:06 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:06 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='03c769e7084c4720fefbe627da195b8d',container_format='bare',created_at=2023-11-08T15:30:06Z,direct_url=<?>,disk_format='qcow2',id=0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-671099388-shelved',owner='6fac0333dca24d81b8127258c41a3145',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T15:30:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'vcpu_model' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.objects.base [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<e162d6d0-3c7d-4b87-8b39-09c17d2fadb6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-156181796',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:30:10.613678',shelved_host='user',shelved_image_id='0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'pci_devices' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.objects.base [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Object Instance<e162d6d0-3c7d-4b87-8b39-09c17d2fadb6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:32:06 user nova-compute[74788]:   <uuid>e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</uuid>
Nov 08 15:32:06 user nova-compute[74788]:   <name>instance-0000001d</name>
Nov 08 15:32:06 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:32:06 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:32:06 user nova-compute[74788]:   <metadata>
Nov 08 15:32:06 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:32:06 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-671099388</nova:name>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:32:06</nova:creationTime>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:32:06 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:32:06 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:owner>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:user uuid="6455bc0197734cce88c64797bd83fc2b">tempest-AttachVolumeShelveTestJSON-300191316-project-member</nova:user>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:project uuid="6fac0333dca24d81b8127258c41a3145">tempest-AttachVolumeShelveTestJSON-300191316</nova:project>
Nov 08 15:32:06 user nova-compute[74788]:       </nova:owner>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:root type="image" uuid="0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5"/>
Nov 08 15:32:06 user nova-compute[74788]:       <nova:ports>
Nov 08 15:32:06 user nova-compute[74788]:         <nova:port uuid="07e83f52-b0ec-4065-a1cf-a1064fa5cbbd">
Nov 08 15:32:06 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 15:32:06 user nova-compute[74788]:         </nova:port>
Nov 08 15:32:06 user nova-compute[74788]:       </nova:ports>
Nov 08 15:32:06 user nova-compute[74788]:     </nova:instance>
Nov 08 15:32:06 user nova-compute[74788]:   </metadata>
Nov 08 15:32:06 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:32:06 user nova-compute[74788]:     <system>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="serial">e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</entry>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="uuid">e162d6d0-3c7d-4b87-8b39-09c17d2fadb6</entry>
Nov 08 15:32:06 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:32:06 user nova-compute[74788]:     </system>
Nov 08 15:32:06 user nova-compute[74788]:   </sysinfo>
Nov 08 15:32:06 user nova-compute[74788]:   <os>
Nov 08 15:32:06 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:32:06 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:32:06 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:32:06 user nova-compute[74788]:   </os>
Nov 08 15:32:06 user nova-compute[74788]:   <features>
Nov 08 15:32:06 user nova-compute[74788]:     <acpi/>
Nov 08 15:32:06 user nova-compute[74788]:     <apic/>
Nov 08 15:32:06 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:32:06 user nova-compute[74788]:   </features>
Nov 08 15:32:06 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:32:06 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:32:06 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:32:06 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:32:06 user nova-compute[74788]:   </clock>
Nov 08 15:32:06 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:32:06 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:32:06 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:32:06 user nova-compute[74788]:   </cpu>
Nov 08 15:32:06 user nova-compute[74788]:   <devices>
Nov 08 15:32:06 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:32:06 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:32:06 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk"/>
Nov 08 15:32:06 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:32:06 user nova-compute[74788]:     </disk>
Nov 08 15:32:06 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:32:06 user nova-compute[74788]:       <mac address="fa:16:3e:e0:ee:ef"/>
Nov 08 15:32:06 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:06 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:32:06 user nova-compute[74788]:       <target dev="tap07e83f52-b0"/>
Nov 08 15:32:06 user nova-compute[74788]:     </interface>
Nov 08 15:32:06 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:32:06 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/console.log" append="off"/>
Nov 08 15:32:06 user nova-compute[74788]:     </serial>
Nov 08 15:32:06 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:32:06 user nova-compute[74788]:     <video>
Nov 08 15:32:06 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:06 user nova-compute[74788]:     </video>
Nov 08 15:32:06 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:32:06 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:32:06 user nova-compute[74788]:     </rng>
Nov 08 15:32:06 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:32:06 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:32:06 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:32:06 user nova-compute[74788]:     </memballoon>
Nov 08 15:32:06 user nova-compute[74788]:   </devices>
Nov 08 15:32:06 user nova-compute[74788]: </domain>
Nov 08 15:32:06 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-156181796',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member',shelved_at='2023-11-08T15:30:10.613678',shelved_host='user',shelved_image_id='0f03a17d-fbd0-4ca3-8d9b-4f9b21d8a9b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG os_vif [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dc30c85-0b1e-5a9e-aa3d-bfb062ef88b4', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07e83f52-b0, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07e83f52-b0, col_values=(('qos', UUID('24c2651d-5694-4c42-90bc-b52f070f769b')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07e83f52-b0, col_values=(('external_ids', {'iface-id': '07e83f52-b0ec-4065-a1cf-a1064fa5cbbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ee:ef', 'vm-uuid': 'e162d6d0-3c7d-4b87-8b39-09c17d2fadb6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance spawned successfully.
Nov 08 15:32:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:32:06 user nova-compute[74788]: INFO os_vif [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0')
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] No VIF found with MAC fa:16:3e:e0:ee:ef, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] No VIF found with MAC fa:16:3e:9a:cc:fc, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:32:06 user nova-compute[74788]: INFO nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 08 15:32:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:32:07 user nova-compute[74788]: INFO nova.compute.manager [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Took 52.51 seconds to build instance.
Nov 08 15:32:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6896f90d-f604-439d-8a00-f24efe546197 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.753s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4da28c06-5e59-4668-a879-821e97a1aaa1 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.695s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:08 user nova-compute[74788]: WARNING nova.compute.manager [req-a60f1127-3406-472d-9e65-b9cc6ca34b32 req-37d89d25-cd41-4df6-af65-4a80541d9a8f service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:09 user nova-compute[74788]: INFO nova.compute.manager [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Detaching volume 9ba5c711-f27a-4c21-b115-38c1ad51df1a
Nov 08 15:32:09 user nova-compute[74788]: INFO nova.virt.block_device [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Attempting to driver detach volume 9ba5c711-f27a-4c21-b115-38c1ad51df1a from mountpoint /dev/vdb
Nov 08 15:32:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Attempting to detach device vdb from instance d4101406-2672-44ee-8db3-2be2e1495a93 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:32:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:32:09 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:32:09 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:32:09 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:32:09 user nova-compute[74788]:   <serial>9ba5c711-f27a-4c21-b115-38c1ad51df1a</serial>
Nov 08 15:32:09 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:32:09 user nova-compute[74788]: </disk>
Nov 08 15:32:09 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:32:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Successfully detached device vdb from instance d4101406-2672-44ee-8db3-2be2e1495a93 from the persistent domain config.
Nov 08 15:32:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4101406-2672-44ee-8db3-2be2e1495a93 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:32:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:32:09 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:32:09 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:32:09 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:32:09 user nova-compute[74788]:   <serial>9ba5c711-f27a-4c21-b115-38c1ad51df1a</serial>
Nov 08 15:32:09 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:32:09 user nova-compute[74788]: </disk>
Nov 08 15:32:09 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:32:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:10 user nova-compute[74788]: WARNING nova.compute.manager [req-b168212f-18ab-4b05-bc97-bfcd8cb47bfe req-431f29f2-ff07-423d-883f-f98b3dd14b8b service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:32:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:32:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:32:10 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance spawned successfully.
Nov 08 15:32:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:32:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0716c9fc-6ca7-42cc-a7c4-8eb9086c0603 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.436s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:32:26 user nova-compute[74788]: INFO nova.compute.claims [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Claim successful on node user
Nov 08 15:32:26 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:32:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.policy [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e567adf9bfe49e58cc73195084c7acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e545713667df40d8b632db43b4f991b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:32:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Creating image(s)
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk 1073741824" returned: 0 in 0.056s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Successfully created port: 5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.204s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:32:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Cannot resize image /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Ensure instance console log exists: /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Successfully updated port: 5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquired lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-changed-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG nova.compute.manager [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Refreshing instance network info cache due to event network-changed-5c2e0154-f2e2-4836-a0a5-b2999c43fc01. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:32:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] Acquiring lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.neutron [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updating instance_info_cache with network_info: [{"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Releasing lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Instance network_info: |[{"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] Acquired lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.neutron [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Refreshing network info cache for port 5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Start _get_guest_xml network_info=[{"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:32:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1536786455',display_name='tempest-AttachVolumeNegativeTest-server-1536786455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1536786455',id=33,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNajLHTwF47BSYASJ8o6MegO2bf0lUXZsSGbH9YAxfUGLQF/CD5vsrsoi1hZPtvEwqL/5WJFg/dXC5f8yJ6K+RBTl6lB7vkghErBVlUGN68JdMZyN/X9ImFVYijGpL5fnQ==',key_name='tempest-keypair-1683511725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-lh3y6fnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=e7614440-9110-4515-b0bc-4309000d37be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'pci_devices' on Instance uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:32:29 user nova-compute[74788]:   <uuid>e7614440-9110-4515-b0bc-4309000d37be</uuid>
Nov 08 15:32:29 user nova-compute[74788]:   <name>instance-00000021</name>
Nov 08 15:32:29 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:32:29 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:32:29 user nova-compute[74788]:   <metadata>
Nov 08 15:32:29 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:32:29 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1536786455</nova:name>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:32:29</nova:creationTime>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:32:29 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:32:29 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:owner>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:user uuid="2e567adf9bfe49e58cc73195084c7acf">tempest-AttachVolumeNegativeTest-1449712443-project-member</nova:user>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:project uuid="e545713667df40d8b632db43b4f991b4">tempest-AttachVolumeNegativeTest-1449712443</nova:project>
Nov 08 15:32:29 user nova-compute[74788]:       </nova:owner>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:32:29 user nova-compute[74788]:       <nova:ports>
Nov 08 15:32:29 user nova-compute[74788]:         <nova:port uuid="5c2e0154-f2e2-4836-a0a5-b2999c43fc01">
Nov 08 15:32:29 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 15:32:29 user nova-compute[74788]:         </nova:port>
Nov 08 15:32:29 user nova-compute[74788]:       </nova:ports>
Nov 08 15:32:29 user nova-compute[74788]:     </nova:instance>
Nov 08 15:32:29 user nova-compute[74788]:   </metadata>
Nov 08 15:32:29 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:32:29 user nova-compute[74788]:     <system>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="serial">e7614440-9110-4515-b0bc-4309000d37be</entry>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="uuid">e7614440-9110-4515-b0bc-4309000d37be</entry>
Nov 08 15:32:29 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:32:29 user nova-compute[74788]:     </system>
Nov 08 15:32:29 user nova-compute[74788]:   </sysinfo>
Nov 08 15:32:29 user nova-compute[74788]:   <os>
Nov 08 15:32:29 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:32:29 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:32:29 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:32:29 user nova-compute[74788]:   </os>
Nov 08 15:32:29 user nova-compute[74788]:   <features>
Nov 08 15:32:29 user nova-compute[74788]:     <acpi/>
Nov 08 15:32:29 user nova-compute[74788]:     <apic/>
Nov 08 15:32:29 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:32:29 user nova-compute[74788]:   </features>
Nov 08 15:32:29 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:32:29 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:32:29 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:32:29 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:32:29 user nova-compute[74788]:   </clock>
Nov 08 15:32:29 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:32:29 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:32:29 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:32:29 user nova-compute[74788]:   </cpu>
Nov 08 15:32:29 user nova-compute[74788]:   <devices>
Nov 08 15:32:29 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:32:29 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:32:29 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk"/>
Nov 08 15:32:29 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:32:29 user nova-compute[74788]:     </disk>
Nov 08 15:32:29 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:32:29 user nova-compute[74788]:       <mac address="fa:16:3e:64:8d:02"/>
Nov 08 15:32:29 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:29 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:32:29 user nova-compute[74788]:       <target dev="tap5c2e0154-f2"/>
Nov 08 15:32:29 user nova-compute[74788]:     </interface>
Nov 08 15:32:29 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:32:29 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/console.log" append="off"/>
Nov 08 15:32:29 user nova-compute[74788]:     </serial>
Nov 08 15:32:29 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:32:29 user nova-compute[74788]:     <video>
Nov 08 15:32:29 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:32:29 user nova-compute[74788]:     </video>
Nov 08 15:32:29 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:32:29 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:32:29 user nova-compute[74788]:     </rng>
Nov 08 15:32:29 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:32:29 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:32:29 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:32:29 user nova-compute[74788]:     </memballoon>
Nov 08 15:32:29 user nova-compute[74788]:   </devices>
Nov 08 15:32:29 user nova-compute[74788]: </domain>
Nov 08 15:32:29 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1536786455',display_name='tempest-AttachVolumeNegativeTest-server-1536786455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1536786455',id=33,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNajLHTwF47BSYASJ8o6MegO2bf0lUXZsSGbH9YAxfUGLQF/CD5vsrsoi1hZPtvEwqL/5WJFg/dXC5f8yJ6K+RBTl6lB7vkghErBVlUGN68JdMZyN/X9ImFVYijGpL5fnQ==',key_name='tempest-keypair-1683511725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-lh3y6fnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=e7614440-9110-4515-b0bc-4309000d37be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_vif [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a88524c8-0658-5fbf-a893-a8974d7999a2', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2e0154-f2, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c2e0154-f2, col_values=(('qos', UUID('704b23d9-7e6f-4901-a0ab-2dabe301cbbd')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c2e0154-f2, col_values=(('external_ids', {'iface-id': '5c2e0154-f2e2-4836-a0a5-b2999c43fc01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:8d:02', 'vm-uuid': 'e7614440-9110-4515-b0bc-4309000d37be'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:29 user nova-compute[74788]: INFO os_vif [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2')
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:64:8d:02, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.neutron [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updated VIF entry in instance network info cache for port 5c2e0154-f2e2-4836-a0a5-b2999c43fc01. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.network.neutron [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updating instance_info_cache with network_info: [{"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f2ee65f9-e5bd-4c5f-8f0a-f69ea2a7ad59 req-5d5c8735-dffc-4e61-97d7-4a61efac237e service nova] Releasing lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:29 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4101406-2672-44ee-8db3-2be2e1495a93 is timed out.
Nov 08 15:32:29 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Successfully detached device vdb from instance d4101406-2672-44ee-8db3-2be2e1495a93 from the live domain config.
Nov 08 15:32:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJsVZDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:32:29 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6d83c-fd98-4862-b20f-cde9f25b9ac2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:32:29 user nova-compute[74788]: No targets found.
Nov 08 15:32:29 user nova-compute[74788]: iSNS:
Nov 08 15:32:29 user nova-compute[74788]: No targets found.
Nov 08 15:32:29 user nova-compute[74788]: STATIC:
Nov 08 15:32:29 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:32:29 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:32:29 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:32:29 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a
Nov 08 15:32:29 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:32:29 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:32:29 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57
Nov 08 15:32:29 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:32:29 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:32:29 user nova-compute[74788]: FIRMWARE:
Nov 08 15:32:29 user nova-compute[74788]: No targets found.
Nov 08 15:32:29 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:32:29 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:32:29 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:32:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10219de4-6738-4524-ae83-a7732063a656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a4cf5-9d38-498d-a956-ffe62b9323a8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:30 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:30 user nova-compute[74788]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)
Nov 08 15:32:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:32:30 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:32:30 user nova-compute[74788]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a (non-flash)
Nov 08 15:32:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c214160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.070s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[565d2e0e-2266-4c08-be5c-b002d95d28c4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf9ab4-0072-41a8-aa69-d702d70d9c25]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b818cf5-5707-4a53-a30d-1684b2ef1848]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce70dee-9e80-4288-9c76-490a39fc90fa]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4a5bf-a4e3-438b-bd0e-676b7715a894]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965cbf4-e168-4ce1-a601-18652f401152]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260]
Nov 08 15:32:30 user nova-compute[74788]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a, portal: 172.16.0.220,3260] successful.
Nov 08 15:32:30 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ba5c711-f27a-4c21-b115-38c1ad51df1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4aa0cc-a87b-4276-83af-b3573b9e3a94]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] <== disconnect_volume: return (407ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] No waiting events found dispatching network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:30 user nova-compute[74788]: WARNING nova.compute.manager [req-24b15e4d-c363-4720-8eb9-5c20b21e7924 req-1e456c95-35a1-4b01-b6ef-138c80c60a4b service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received unexpected event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 for instance with vm_state building and task_state spawning.
Nov 08 15:32:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:31 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lazy-loading 'flavor' on Instance uuid d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:32:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a056a043-815c-42b5-829e-cdcc3af51402 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.342s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] No waiting events found dispatching network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:32:33 user nova-compute[74788]: WARNING nova.compute.manager [req-3c5812e1-dfdc-4a5c-a9fe-9dc2286df19c req-6264650d-2930-4ad0-a57a-8a32f70b09a8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received unexpected event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 for instance with vm_state building and task_state spawning.
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:32:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] Instance spawned successfully.
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:32:33 user nova-compute[74788]: INFO nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 08 15:32:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:32:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:33 user nova-compute[74788]: INFO nova.compute.manager [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Took 6.80 seconds to build instance.
Nov 08 15:32:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e5206fc5-5012-408d-bfc3-2ec6d68f1733 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:40 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:32:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:32:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:48 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:32:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:32:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.260986328125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d4101406-2672-44ee-8db3-2be2e1495a93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:32:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:32:56 user nova-compute[74788]: INFO nova.compute.claims [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Claim successful on node user
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:32:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:32:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:32:57 user nova-compute[74788]: INFO nova.virt.block_device [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Booting with volume snapshot e78b34b2-14d4-4b1d-93de-c849757936bf at /dev/vda
Nov 08 15:32:57 user nova-compute[74788]: DEBUG nova.policy [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:32:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Successfully created port: 4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:32:57 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Successfully updated port: 4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-changed-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Refreshing instance network info cache due to event network-changed-4c401aea-92a3-498e-bd0d-75b955a585be. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] Acquiring lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updating instance_info_cache with network_info: [{"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Instance network_info: |[{"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] Acquired lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:32:58 user nova-compute[74788]: DEBUG nova.network.neutron [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Refreshing network info cache for port 4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:32:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:32:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updated VIF entry in instance network info cache for port 4c401aea-92a3-498e-bd0d-75b955a585be. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:32:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updating instance_info_cache with network_info: [{"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:32:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8c7050c7-f450-4e1a-9823-de9bfeff14fa req-ac99d84f-3185-40a2-9112-80638778765a service nova] Releasing lock "refresh_cache-15e88add-5cca-4315-9d16-f3e0ffc2c3f9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.utils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51868a8f-b6ce-4477-972c-dabeac97c17d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d8c4a-7077-4651-967c-e70cc8228735]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[71433a35-7384-4e45-a26b-fe4654001bcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58533c-f6c7-4aee-b3a6-5e49c538e4e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:33:03 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:33:03 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc88307-ed3a-481f-8d69-314bee36fc1f]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG os_brick.utils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updating existing volume attachment record: a3ad64cb-1047-4ec9-a0d2-7d386a8ab54b {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:33:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:08 user nova-compute[74788]: INFO nova.compute.manager [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Unrescuing
Nov 08 15:33:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:33:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:33:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:33:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'flavor' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:09 user nova-compute[74788]: WARNING nova.compute.manager [req-a426a3a5-f4a6-4092-90f1-53dc29a39432 req-9954f0b6-7e15-4ab3-8fc9-f8f36ab037c3 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-unplugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:33:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance destroyed successfully.
Nov 08 15:33:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:10 user nova-compute[74788]: INFO nova.compute.manager [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Terminating instance
Nov 08 15:33:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:11 user nova-compute[74788]: WARNING nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-unplugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] No waiting events found dispatching network-vif-unplugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-unplugged-76645b1b-f388-4bef-9268-24fe0f9a9636 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Acquiring lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "d4101406-2672-44ee-8db3-2be2e1495a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] No waiting events found dispatching network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:11 user nova-compute[74788]: WARNING nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received unexpected event network-vif-plugged-76645b1b-f388-4bef-9268-24fe0f9a9636 for instance with vm_state active and task_state deleting.
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:11 user nova-compute[74788]: WARNING nova.compute.manager [req-0abee540-46d1-42d1-acf1-891498e8a720 req-e9c21b99-f0c7-4dba-b281-062220083372 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Instance destroyed successfully.
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lazy-loading 'resources' on Instance uuid d4101406-2672-44ee-8db3-2be2e1495a93 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1415982270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1415982',id=31,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFANaJZ45AD8phoCw7Oq052RVj0IfzpKaDWCvtZDCpIfGNb1fEqRYqO1ngEv+CE4Rmc9rjiA8sxMu1HOkIyL8qT1h1J6p957p52Nm8/ptLaH+XhFxGfhO6n5ZCZQLeuhA==',key_name='tempest-keypair-1844452545',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e024f79d64fe4a7da3cbdced0d861c70',ramdisk_id='',reservation_id='r-7rtidgq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bda1bc3f1fb4a1fa548a478724c28b1',uuid=d4101406-2672-44ee-8db3-2be2e1495a93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converting VIF {"id": "76645b1b-f388-4bef-9268-24fe0f9a9636", "address": "fa:16:3e:9a:cc:fc", "network": {"id": "0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1216026985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e024f79d64fe4a7da3cbdced0d861c70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76645b1b-f3", "ovs_interfaceid": "76645b1b-f388-4bef-9268-24fe0f9a9636", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG os_vif [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76645b1b-f3, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4941003b-c6d1-48f2-b66c-535d80820ce5) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:11 user nova-compute[74788]: INFO os_vif [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:cc:fc,bridge_name='br-int',has_traffic_filtering=True,id=76645b1b-f388-4bef-9268-24fe0f9a9636,network=Network(0a932dc1-94e8-4ce4-ac33-5e6b54dc36a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76645b1b-f3')
Nov 08 15:33:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Deleting instance files /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93_del
Nov 08 15:33:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Deletion of /opt/stack/data/nova/instances/d4101406-2672-44ee-8db3-2be2e1495a93_del complete
Nov 08 15:33:11 user nova-compute[74788]: INFO nova.compute.manager [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 15:33:11 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:33:11 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:33:12 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:12 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Took 0.82 seconds to deallocate network for instance.
Nov 08 15:33:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:33:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:33:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:12 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Deleted allocations for instance d4101406-2672-44ee-8db3-2be2e1495a93
Nov 08 15:33:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df6d70f2-1e2e-48cc-944e-167c69cd0ef6 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243 tempest-TestServerVolumeAttachScenarioOldVersion-1327018243-project-member] Lock "d4101406-2672-44ee-8db3-2be2e1495a93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] No waiting events found dispatching network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:13 user nova-compute[74788]: WARNING nova.compute.manager [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received unexpected event network-vif-plugged-5b2757df-faeb-4fdb-8add-612e784b5195 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:33:13 user nova-compute[74788]: DEBUG nova.compute.manager [req-1aa9c16b-48d3-4844-b6d3-8ba2bfe67be7 req-d243ede4-74d2-4e2a-ba68-5643236f8bb5 service nova] [instance: d4101406-2672-44ee-8db3-2be2e1495a93] Received event network-vif-deleted-76645b1b-f388-4bef-9268-24fe0f9a9636 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8287b4fc-2df5-4bef-bfdb-b4bd3aae6e51 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:33:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:33:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:33:26 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Creating image(s)
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Ensure instance console log exists: /opt/stack/data/nova/instances/15e88add-5cca-4315-9d16-f3e0ffc2c3f9/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Start _get_guest_xml network_info=[{"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYDWUcLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15e88add-5cca-4315-9d16-f3e0ffc2c3f9', 'attached_at': '', 'detached_at': '', 'volume_id': '4ff31ac9-9920-4f5f-8968-98f878dcbb82', 'serial': '4ff31ac9-9920-4f5f-8968-98f878dcbb82'}, 'attachment_id': 'a3ad64cb-1047-4ec9-a0d2-7d386a8ab54b', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:33:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:33:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYDWUcLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:33:26 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:33:26 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:33:26 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a0989-0ec8-49f3-aeeb-91aa70d5aceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:33:26 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[297fa798-2ceb-4319-978d-da3bcc72cb38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82] added
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[076eb4ca-e4c7-4f2a-84be-9281549a8290]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d496ab-2f43-48f1-8122-afa4df660303]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYDWUcLb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYDWUcLb" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc51e87-5e77-4c09-99d5-3893fe93e8de]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYDWUcLb'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d510a-70fc-4fa0-ba7d-c913159c174f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b448d6-9bb4-4d22-8275-95a3cc0008fb]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f8006-7b81-4dcb-b2ad-8f358805950f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260]
Nov 08 15:33:26 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260] successful.
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c658ef6b-5cd2-410f-b009-2cb5589c6b25]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c303a67-8467-42b9-857f-a0b3f713fe3a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:26 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:33:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333a0b7-7f9f-4944-96f1-6c87e8f11647]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:33:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYDWUcLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23239366364653732', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239366364653732', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1804393794',display_name='tempest-TestVolumeBootPattern-server-1804393794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1804393794',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-s3rx5pld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:32:57Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=15e88add-5cca-4315-9d16-f3e0ffc2c3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.objects.instance [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'pci_devices' on Instance uuid 15e88add-5cca-4315-9d16-f3e0ffc2c3f9 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:33:27 user nova-compute[74788]:   <uuid>15e88add-5cca-4315-9d16-f3e0ffc2c3f9</uuid>
Nov 08 15:33:27 user nova-compute[74788]:   <name>instance-00000022</name>
Nov 08 15:33:27 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:33:27 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:33:27 user nova-compute[74788]:   <metadata>
Nov 08 15:33:27 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:33:27 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:33:27 user nova-compute[74788]:       <nova:name>tempest-TestVolumeBootPattern-server-1804393794</nova:name>
Nov 08 15:33:27 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:33:26</nova:creationTime>
Nov 08 15:33:27 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:33:27 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:33:27 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:33:27 user nova-compute[74788]:       <nova:owner>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:user uuid="9655d103734d485691fe3d82e4e68032">tempest-TestVolumeBootPattern-1548248568-project-member</nova:user>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:project uuid="ef632441d171499280801b367697b620">tempest-TestVolumeBootPattern-1548248568</nova:project>
Nov 08 15:33:27 user nova-compute[74788]:       </nova:owner>
Nov 08 15:33:27 user nova-compute[74788]:       <nova:ports>
Nov 08 15:33:27 user nova-compute[74788]:         <nova:port uuid="4c401aea-92a3-498e-bd0d-75b955a585be">
Nov 08 15:33:27 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 15:33:27 user nova-compute[74788]:         </nova:port>
Nov 08 15:33:27 user nova-compute[74788]:       </nova:ports>
Nov 08 15:33:27 user nova-compute[74788]:     </nova:instance>
Nov 08 15:33:27 user nova-compute[74788]:   </metadata>
Nov 08 15:33:27 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:33:27 user nova-compute[74788]:     <system>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="serial">15e88add-5cca-4315-9d16-f3e0ffc2c3f9</entry>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="uuid">15e88add-5cca-4315-9d16-f3e0ffc2c3f9</entry>
Nov 08 15:33:27 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:33:27 user nova-compute[74788]:     </system>
Nov 08 15:33:27 user nova-compute[74788]:   </sysinfo>
Nov 08 15:33:27 user nova-compute[74788]:   <os>
Nov 08 15:33:27 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:33:27 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:33:27 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:33:27 user nova-compute[74788]:   </os>
Nov 08 15:33:27 user nova-compute[74788]:   <features>
Nov 08 15:33:27 user nova-compute[74788]:     <acpi/>
Nov 08 15:33:27 user nova-compute[74788]:     <apic/>
Nov 08 15:33:27 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:33:27 user nova-compute[74788]:   </features>
Nov 08 15:33:27 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:33:27 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:33:27 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:33:27 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:33:27 user nova-compute[74788]:   </clock>
Nov 08 15:33:27 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:33:27 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:33:27 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:33:27 user nova-compute[74788]:   </cpu>
Nov 08 15:33:27 user nova-compute[74788]:   <devices>
Nov 08 15:33:27 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:33:27 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:33:27 user nova-compute[74788]:       <source dev="/dev/sdd"/>
Nov 08 15:33:27 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:33:27 user nova-compute[74788]:       <serial>4ff31ac9-9920-4f5f-8968-98f878dcbb82</serial>
Nov 08 15:33:27 user nova-compute[74788]:     </disk>
Nov 08 15:33:27 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:33:27 user nova-compute[74788]:       <mac address="fa:16:3e:17:6f:4a"/>
Nov 08 15:33:27 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:33:27 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:33:27 user nova-compute[74788]:       <target dev="tap4c401aea-92"/>
Nov 08 15:33:27 user nova-compute[74788]:     </interface>
Nov 08 15:33:27 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:33:27 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/15e88add-5cca-4315-9d16-f3e0ffc2c3f9/console.log" append="off"/>
Nov 08 15:33:27 user nova-compute[74788]:     </serial>
Nov 08 15:33:27 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:33:27 user nova-compute[74788]:     <video>
Nov 08 15:33:27 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:33:27 user nova-compute[74788]:     </video>
Nov 08 15:33:27 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:33:27 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:33:27 user nova-compute[74788]:     </rng>
Nov 08 15:33:27 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:33:27 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:33:27 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:33:27 user nova-compute[74788]:     </memballoon>
Nov 08 15:33:27 user nova-compute[74788]:   </devices>
Nov 08 15:33:27 user nova-compute[74788]: </domain>
Nov 08 15:33:27 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1804393794',display_name='tempest-TestVolumeBootPattern-server-1804393794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1804393794',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-s3rx5pld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:32:57Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=15e88add-5cca-4315-9d16-f3e0ffc2c3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG os_vif [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a2a146c-3bb4-508d-927b-a0cf92becd1d', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c401aea-92, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c401aea-92, col_values=(('qos', UUID('86a715b5-d33d-4017-a980-8f57efbd6f1e')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c401aea-92, col_values=(('external_ids', {'iface-id': '4c401aea-92a3-498e-bd0d-75b955a585be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:6f:4a', 'vm-uuid': '15e88add-5cca-4315-9d16-f3e0ffc2c3f9'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:27 user nova-compute[74788]: INFO os_vif [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92')
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:33:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No VIF found with MAC fa:16:3e:17:6f:4a, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:33:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] No waiting events found dispatching network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:29 user nova-compute[74788]: WARNING nova.compute.manager [req-1b73d317-9ef4-4f1c-bc04-4da36f989bb9 req-a733d486-6b41-4fcb-a968-6f5729393f07 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received unexpected event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be for instance with vm_state building and task_state spawning.
Nov 08 15:33:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:33:31 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Instance spawned successfully.
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] No waiting events found dispatching network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:31 user nova-compute[74788]: WARNING nova.compute.manager [req-219ac3fb-6cf5-42cf-8ba2-afe5f4b5b812 req-bcc3edc2-47fc-4e8c-a591-206f84969ee7 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received unexpected event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be for instance with vm_state building and task_state spawning.
Nov 08 15:33:31 user nova-compute[74788]: INFO nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 08 15:33:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:33:31 user nova-compute[74788]: INFO nova.compute.manager [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Took 35.28 seconds to build instance.
Nov 08 15:33:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-abefa3b1-a73c-485e-9db3-66a204f2af43 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.396s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:48 user nova-compute[74788]: INFO nova.compute.manager [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Terminating instance
Nov 08 15:33:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:33:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-93c41d71-60c6-48c2-8370-5e6ef1d35be4 req-ecd7d507-c91b-49b4-bccf-aa5c42c3a0f3 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-unplugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:33:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Instance destroyed successfully.
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lazy-loading 'resources' on Instance uuid e162d6d0-3c7d-4b87-8b39-09c17d2fadb6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:28:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-671099388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-671099388',id=29,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCibB0yyuXrZ3CTeTiEDSDGlXqipDK/7qt+NPNltQbiMhjo3HOgAuZjwgreV+rXAqbrWxXpu+KpCW3T6x19pDexYVxbVSzsKIhiWO3Gz+OKpQ8VFtRoI9lphje7yL6ODw==',key_name='tempest-keypair-156181796',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fac0333dca24d81b8127258c41a3145',ramdisk_id='',reservation_id='r-u4dcznzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-300191316',owner_user_name='tempest-AttachVolumeShelveTestJSON-300191316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6455bc0197734cce88c64797bd83fc2b',uuid=e162d6d0-3c7d-4b87-8b39-09c17d2fadb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converting VIF {"id": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "address": "fa:16:3e:e0:ee:ef", "network": {"id": "9e6217bf-0e28-4dd5-827a-53e7c3bf9c18", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-678244945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fac0333dca24d81b8127258c41a3145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e83f52-b0", "ovs_interfaceid": "07e83f52-b0ec-4065-a1cf-a1064fa5cbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG os_vif [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07e83f52-b0, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24c2651d-5694-4c42-90bc-b52f070f769b) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:49 user nova-compute[74788]: INFO os_vif [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ee:ef,bridge_name='br-int',has_traffic_filtering=True,id=07e83f52-b0ec-4065-a1cf-a1064fa5cbbd,network=Network(9e6217bf-0e28-4dd5-827a-53e7c3bf9c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e83f52-b0')
Nov 08 15:33:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Deleting instance files /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6_del
Nov 08 15:33:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Deletion of /opt/stack/data/nova/instances/e162d6d0-3c7d-4b87-8b39-09c17d2fadb6_del complete
Nov 08 15:33:49 user nova-compute[74788]: INFO nova.compute.manager [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [{"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-6a9abf8f-0442-45c7-9d91-2a1c062437d7" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:33:50 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Took 0.68 seconds to deallocate network for instance.
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-b49515b8-2811-4378-8e01-f7fec24a3040 req-fa8a7b85-ca7a-486e-997b-7e42d57150cd service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-deleted-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:50 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:51 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Deleted allocations for instance e162d6d0-3c7d-4b87-8b39-09c17d2fadb6
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cfd42424-fddd-41f5-9bb2-b5f10ed74a35 tempest-AttachVolumeShelveTestJSON-300191316 tempest-AttachVolumeShelveTestJSON-300191316-project-member] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.217s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] Acquiring lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] Lock "e162d6d0-3c7d-4b87-8b39-09c17d2fadb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] No waiting events found dispatching network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:51 user nova-compute[74788]: WARNING nova.compute.manager [req-68475298-7f1f-4849-8494-ee5cd4642235 req-7390d43f-6044-43de-9ca7-fa19facd6408 service nova] [instance: e162d6d0-3c7d-4b87-8b39-09c17d2fadb6] Received unexpected event network-vif-plugged-07e83f52-b0ec-4065-a1cf-a1064fa5cbbd for instance with vm_state deleted and task_state None.
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:33:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:33:52 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=25.304401397705078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 15e88add-5cca-4315-9d16-f3e0ffc2c3f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:33:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:33:53 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:33:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:33:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:33:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing instance network info cache due to event network-changed-384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:33:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:33:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:33:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Refreshing network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:33:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated VIF entry in instance network info cache for port 384c3842-8fb5-435d-8451-91efba79f9b8. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:33:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ef2cb612-0ee8-4761-8a5a-a9b66f549bd6 req-ead47413-df7f-4a8b-902f-be69476e84c8 service nova] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Stashing vm_state: active {{(pid=74788) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:33:58 user nova-compute[74788]: INFO nova.compute.claims [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Claim successful on node user
Nov 08 15:33:58 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating resource usage from migration 1a1b4cf2-af55-4a17-89cc-dfdd5bdf8480
Nov 08 15:33:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.329s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:58 user nova-compute[74788]: INFO nova.compute.manager [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Migrating
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-changed-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Refreshing instance network info cache due to event network-changed-8a40c838-2845-4846-a1b9-c39fc25d8044. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.neutron [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Refreshing network info cache for port 8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Starting migrate_disk_and_power_off {{(pid=74788) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:33:59 user nova-compute[74788]: WARNING nova.compute.manager [req-a9d0c926-c3d4-4d39-8ff4-8c0e084e5f37 req-61081f2a-afab-4998-a6e9-7e33ca72a5e5 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state active and task_state resize_migrating.
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updated VIF entry in instance network info cache for port 8a40c838-2845-4846-a1b9-c39fc25d8044. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-20fdbdd5-d2d9-436d-ae71-fcc261e5d825 req-b8b7f37e-91b9-4aab-9963-6b8521f02318 service nova] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance destroyed successfully.
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a40c838-28, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dcb8a4d-6b28-43c4-832d-629fc7d4b50b) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:33:59 user nova-compute[74788]: INFO os_vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28')
Nov 08 15:33:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:33:59 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2394a1c3-c8b2-469e-b9d7-044bd54afdcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:33:59 user nova-compute[74788]: No targets found.
Nov 08 15:33:59 user nova-compute[74788]: iSNS:
Nov 08 15:33:59 user nova-compute[74788]: No targets found.
Nov 08 15:33:59 user nova-compute[74788]: STATIC:
Nov 08 15:33:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:33:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:33:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:33:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57
Nov 08 15:33:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:33:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:33:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82
Nov 08 15:33:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:33:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:33:59 user nova-compute[74788]: FIRMWARE:
Nov 08 15:33:59 user nova-compute[74788]: No targets found.
Nov 08 15:33:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:33:59 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:33:59 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b2467-55e5-445a-815b-abafcb8450c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff1279-467f-4a9b-9fc8-123596db2577]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:59 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:59 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:33:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:33:59 user nova-compute[74788]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:33:59 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:33:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758469630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:33:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[691cada6-b8fb-4c98-8bf1-f763a9a65ec7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d308d-b2fe-4be5-91a8-3bdc1977e8af]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd677322-4422-4fb2-ab93-520ed9e2512b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[69425f6d-1cd2-4a67-821e-df28a40dc55e]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8473221-2a10-4a50-9f78-02eeab3850e9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d20ae-6e30-4e0d-b4ed-273f0d4390f3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]
Nov 08 15:34:00 user nova-compute[74788]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.
Nov 08 15:34:00 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c42b8-d983-4798-98fa-2f803bb83d62]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== disconnect_volume: return (334ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:34:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Port 8a40c838-2845-4846-a1b9-c39fc25d8044 binding to destination host user is already ACTIVE {{(pid=74788) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:34:01 user nova-compute[74788]: WARNING nova.compute.manager [req-731991f5-0cf8-4ba0-b90b-02f2c2ed1dcb req-79497138-e5d7-490e-8927-16421b41ff40 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state active and task_state resize_migrating.
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:34:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.utils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca61931-c07a-47e8-9dec-bfb1629375eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e22995b-cffa-4a7d-819e-006d90552f63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75455929-16dd-46a5-a373-dc36c7294721]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42776f3e-db06-47c1-8d2d-ce97edb002a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:34:02 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:34:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45959ce8-a6ce-46ec-8084-f06510e9432c]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:34:02 user nova-compute[74788]: DEBUG os_brick.utils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:34:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-changed-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Refreshing instance network info cache due to event network-changed-5c2e0154-f2e2-4836-a0a5-b2999c43fc01. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:34:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] Acquiring lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:34:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] Acquired lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:34:17 user nova-compute[74788]: DEBUG nova.network.neutron [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Refreshing network info cache for port 5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:34:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updated VIF entry in instance network info cache for port 5c2e0154-f2e2-4836-a0a5-b2999c43fc01. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:34:18 user nova-compute[74788]: DEBUG nova.network.neutron [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updating instance_info_cache with network_info: [{"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:34:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ff87b99d-be95-4943-a397-cdb198d82d51 req-4242a637-ce31-447b-980f-f08e9d7ce2fe service nova] Releasing lock "refresh_cache-e7614440-9110-4515-b0bc-4309000d37be" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:34:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:24 user nova-compute[74788]: INFO nova.compute.manager [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Attaching volume a6d4669f-62eb-42b9-800d-1fc3ad18202d to /dev/vdb
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.utils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1378cfb7-2a66-4604-9e6f-d5f7bdc7e1ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ddca06-99c1-4944-8973-c995323677a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86cb57-6e14-4812-b7f7-57c6c2453d3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ec3eb-d79a-4f46-9419-2333708069de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:34:24 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da90368-4afb-4bc4-9e5e-8f0c6a3d3f74]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.utils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updating existing volume attachment record: 3f76cc88-1e5a-47c8-9c55-3424954cfa7f {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Starting finish_migration {{(pid=74788) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:34:24 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Creating image(s)
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start _get_guest_xml network_info=[{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c8c68545-480e-469e-88eb-44a996062ca6', 'attached_at': '2023-11-08T15:34:24.000000', 'detached_at': '', 'volume_id': '734aae35-4d1a-45a5-bf01-1d5198410a4e', 'serial': '734aae35-4d1a-45a5-bf01-1d5198410a4e'}, 'attachment_id': '4ac5f81b-a0e0-4312-a0d4-da267e6dd97f', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:34:24 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:34:24 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:44Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:34:24 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:34:24 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:34:24 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8174a1-0b23-4bc2-b4de-8de64ba33555]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:34:24 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b3d090-a9b2-4b34-b2fa-02b34718d229]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e] added
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b1f261-90d3-4ba8-a74c-e96f221f08d9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[15219f44-de3c-456e-848c-7a7722e00d3e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbyPXZSW {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbyPXZSW" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a0c33-1800-41c3-b6d7-44e6ca924c75]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbyPXZSW'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe65bc67-ea3c-4958-964e-c8db572af037]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1af1c7-40aa-42f2-a43b-f9bf3f573461]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f3bd9-2633-42d9-bc42-6fe46aaefaf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]
Nov 08 15:34:24 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a488433-299d-41d3-b343-217fb83113a9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5468c63a-d0f3-4a68-9069-dfa0a35936b4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:24 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:34:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e400c-6769-4b27-8faa-06af20f90cb0]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23863363066343766', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863363066343766', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:34:26 user nova-compute[74788]:   <uuid>c8c68545-480e-469e-88eb-44a996062ca6</uuid>
Nov 08 15:34:26 user nova-compute[74788]:   <name>instance-00000020</name>
Nov 08 15:34:26 user nova-compute[74788]:   <memory>2097152</memory>
Nov 08 15:34:26 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:34:26 user nova-compute[74788]:   <metadata>
Nov 08 15:34:26 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:34:26 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:34:26 user nova-compute[74788]:       <nova:name>tempest-ServerActionsTestOtherA-server-23126705</nova:name>
Nov 08 15:34:26 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:34:24</nova:creationTime>
Nov 08 15:34:26 user nova-compute[74788]:       <nova:flavor name="m1.small">
Nov 08 15:34:26 user nova-compute[74788]:         <nova:memory>2048</nova:memory>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:disk>20</nova:disk>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:34:26 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:34:26 user nova-compute[74788]:       <nova:owner>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:user uuid="30bfaf63a8bf4172b0a72ee8536a76b2">tempest-ServerActionsTestOtherA-27641552-project-member</nova:user>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:project uuid="c097c366f91c496e9f5a4cfaff0e14c6">tempest-ServerActionsTestOtherA-27641552</nova:project>
Nov 08 15:34:26 user nova-compute[74788]:       </nova:owner>
Nov 08 15:34:26 user nova-compute[74788]:       <nova:ports>
Nov 08 15:34:26 user nova-compute[74788]:         <nova:port uuid="8a40c838-2845-4846-a1b9-c39fc25d8044">
Nov 08 15:34:26 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:34:26 user nova-compute[74788]:         </nova:port>
Nov 08 15:34:26 user nova-compute[74788]:       </nova:ports>
Nov 08 15:34:26 user nova-compute[74788]:     </nova:instance>
Nov 08 15:34:26 user nova-compute[74788]:   </metadata>
Nov 08 15:34:26 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:34:26 user nova-compute[74788]:     <system>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="serial">c8c68545-480e-469e-88eb-44a996062ca6</entry>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="uuid">c8c68545-480e-469e-88eb-44a996062ca6</entry>
Nov 08 15:34:26 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:34:26 user nova-compute[74788]:     </system>
Nov 08 15:34:26 user nova-compute[74788]:   </sysinfo>
Nov 08 15:34:26 user nova-compute[74788]:   <os>
Nov 08 15:34:26 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:34:26 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:34:26 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:34:26 user nova-compute[74788]:   </os>
Nov 08 15:34:26 user nova-compute[74788]:   <features>
Nov 08 15:34:26 user nova-compute[74788]:     <acpi/>
Nov 08 15:34:26 user nova-compute[74788]:     <apic/>
Nov 08 15:34:26 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:34:26 user nova-compute[74788]:   </features>
Nov 08 15:34:26 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:34:26 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:34:26 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:34:26 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:34:26 user nova-compute[74788]:   </clock>
Nov 08 15:34:26 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:34:26 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:34:26 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:34:26 user nova-compute[74788]:   </cpu>
Nov 08 15:34:26 user nova-compute[74788]:   <devices>
Nov 08 15:34:26 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:34:26 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:34:26 user nova-compute[74788]:       <source dev="/dev/sdc"/>
Nov 08 15:34:26 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:34:26 user nova-compute[74788]:       <serial>734aae35-4d1a-45a5-bf01-1d5198410a4e</serial>
Nov 08 15:34:26 user nova-compute[74788]:     </disk>
Nov 08 15:34:26 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:34:26 user nova-compute[74788]:       <mac address="fa:16:3e:84:2e:d9"/>
Nov 08 15:34:26 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:34:26 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:34:26 user nova-compute[74788]:       <target dev="tap8a40c838-28"/>
Nov 08 15:34:26 user nova-compute[74788]:     </interface>
Nov 08 15:34:26 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:34:26 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6/console.log" append="off"/>
Nov 08 15:34:26 user nova-compute[74788]:     </serial>
Nov 08 15:34:26 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:34:26 user nova-compute[74788]:     <video>
Nov 08 15:34:26 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:34:26 user nova-compute[74788]:     </video>
Nov 08 15:34:26 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:34:26 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:34:26 user nova-compute[74788]:     </rng>
Nov 08 15:34:26 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:34:26 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:34:26 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:34:26 user nova-compute[74788]:     </memballoon>
Nov 08 15:34:26 user nova-compute[74788]:   </devices>
Nov 08 15:34:26 user nova-compute[74788]: </domain>
Nov 08 15:34:26 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-334563219-network", "vif_mac": "fa:16:3e:84:2e:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG os_vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '512fcc81-5c5c-591c-b39c-f0a44a626239', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a40c838-28, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a40c838-28, col_values=(('qos', UUID('1f89eccb-54cf-4436-9092-f7055f52ef60')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a40c838-28, col_values=(('external_ids', {'iface-id': '8a40c838-2845-4846-a1b9-c39fc25d8044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:2e:d9', 'vm-uuid': 'c8c68545-480e-469e-88eb-44a996062ca6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:26 user nova-compute[74788]: INFO os_vif [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28')
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:34:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] No VIF found with MAC fa:16:3e:84:2e:d9, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:34:27 user nova-compute[74788]: WARNING nova.compute.manager [req-d107e1ca-0fc0-44ee-a497-1603e760c213 req-e150eadb-fc4e-4b82-bf6d-1f00885b45f9 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state active and task_state resize_finish.
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:34:29 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance running successfully.
Nov 08 15:34:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Failed to set time: agent not configured {{(pid=74788) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-34aaf120-95b1-46d7-8abc-c498cea6dfea tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] finish_migration finished successfully. {{(pid=74788) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:34:29 user nova-compute[74788]: WARNING nova.compute.manager [req-4a2356d5-378b-4d1f-9c76-c697c46a01dd req-e1f83475-231a-403b-aad5-bd7f045e6700 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state active and task_state resize_finish.
Nov 08 15:34:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:46 user nova-compute[74788]: INFO nova.compute.manager [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Terminating instance
Nov 08 15:34:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-unplugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] No waiting events found dispatching network-vif-unplugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-d6b8381c-55a9-4dda-a1ed-f8c2643e2f63 req-87b4d948-5feb-4b51-a852-2269c9975344 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-unplugged-4c401aea-92a3-498e-bd0d-75b955a585be for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Instance destroyed successfully.
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'resources' on Instance uuid 15e88add-5cca-4315-9d16-f3e0ffc2c3f9 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1804393794',display_name='tempest-TestVolumeBootPattern-server-1804393794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1804393794',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-s3rx5pld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:33:32Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=15e88add-5cca-4315-9d16-f3e0ffc2c3f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "4c401aea-92a3-498e-bd0d-75b955a585be", "address": "fa:16:3e:17:6f:4a", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c401aea-92", "ovs_interfaceid": "4c401aea-92a3-498e-bd0d-75b955a585be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_vif [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c401aea-92, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86a715b5-d33d-4017-a980-8f57efbd6f1e) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:47 user nova-compute[74788]: INFO os_vif [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:6f:4a,bridge_name='br-int',has_traffic_filtering=True,id=4c401aea-92a3-498e-bd0d-75b955a585be,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c401aea-92')
Nov 08 15:34:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYDWUcLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:34:47 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259e129-65a7-4696-ac93-b23c6158ee35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:34:47 user nova-compute[74788]: No targets found.
Nov 08 15:34:47 user nova-compute[74788]: iSNS:
Nov 08 15:34:47 user nova-compute[74788]: No targets found.
Nov 08 15:34:47 user nova-compute[74788]: STATIC:
Nov 08 15:34:47 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:34:47 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:34:47 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:34:47 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57
Nov 08 15:34:47 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:34:47 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:34:47 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82
Nov 08 15:34:47 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:34:47 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:34:47 user nova-compute[74788]: FIRMWARE:
Nov 08 15:34:47 user nova-compute[74788]: No targets found.
Nov 08 15:34:47 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:34:47 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:34:47 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8360b4-4abb-432c-ba74-c59ee1cc59c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7bea3-6417-4e57-b130-a228544b0d60]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:47 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:47 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:47 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:47 user nova-compute[74788]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 (non-flash)
Nov 08 15:34:47 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:47 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c215090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[49969454-6f7a-4691-852a-851aaec98f98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5c9c8-6037-4c18-8c5c-2bb9bfce0ee7]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93722572-f0a8-4f9d-af55-d3415cb0cd67]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[435dadec-229d-4ce0-8266-b5575fbd55a4]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaaf71dab-296cde729d5dc78c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aaf71dab', '/dev/disk/by-id/scsi-23239366364653732') {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eecd21d-3363-4e15-b166-56f5df66ff07]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90127ab-b1f8-45c1-ae2b-233610bcd643]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc5d45-9488-42c9-a9b5-226d92d70c70]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260]
Nov 08 15:34:48 user nova-compute[74788]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82, portal: 172.16.0.220,3260] successful.
Nov 08 15:34:48 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ff31ac9-9920-4f5f-8968-98f878dcbb82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a283b2-691f-4614-a3bf-564e5b03c29d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== disconnect_volume: return (317ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:34:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Deleting instance files /opt/stack/data/nova/instances/15e88add-5cca-4315-9d16-f3e0ffc2c3f9_del
Nov 08 15:34:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Deletion of /opt/stack/data/nova/instances/15e88add-5cca-4315-9d16-f3e0ffc2c3f9_del complete
Nov 08 15:34:48 user nova-compute[74788]: INFO nova.compute.manager [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 15:34:48 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:34:48 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Took 0.44 seconds to deallocate network for instance.
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-94fce464-879c-4479-bfc0-3c219d31fa64 req-6c9bb085-0841-45ec-a106-6dcc85f1b82d service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-deleted-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:48 user nova-compute[74788]: INFO nova.compute.manager [req-94fce464-879c-4479-bfc0-3c219d31fa64 req-6c9bb085-0841-45ec-a106-6dcc85f1b82d service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Neutron deleted interface 4c401aea-92a3-498e-bd0d-75b955a585be; detaching it from the instance and deleting it from the info cache
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-94fce464-879c-4479-bfc0-3c219d31fa64 req-6c9bb085-0841-45ec-a106-6dcc85f1b82d service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:34:48 user nova-compute[74788]: DEBUG nova.compute.manager [req-94fce464-879c-4479-bfc0-3c219d31fa64 req-6c9bb085-0841-45ec-a106-6dcc85f1b82d service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Detach interface failed, port_id=4c401aea-92a3-498e-bd0d-75b955a585be, reason: Instance 15e88add-5cca-4315-9d16-f3e0ffc2c3f9 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] Acquiring lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.compute.manager [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] No waiting events found dispatching network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:34:49 user nova-compute[74788]: WARNING nova.compute.manager [req-eec96553-6957-404a-9685-df020d67e336 req-9d15a94d-34c7-4bbc-9966-c635884ffa58 service nova] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Received unexpected event network-vif-plugged-4c401aea-92a3-498e-bd0d-75b955a585be for instance with vm_state active and task_state deleting.
Nov 08 15:34:49 user nova-compute[74788]: INFO nova.compute.manager [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Took 0.90 seconds to detach 1 volumes for instance.
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 15e88add-5cca-4315-9d16-f3e0ffc2c3f9] Deleting volume: 4ff31ac9-9920-4f5f-8968-98f878dcbb82 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:49 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance 15e88add-5cca-4315-9d16-f3e0ffc2c3f9
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8456ffc9-c61a-41eb-adf2-2132256e9342 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "15e88add-5cca-4315-9d16-f3e0ffc2c3f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:34:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:50 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:53 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:34:53 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=25.301128387451172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Applying migration context for instance c8c68545-480e-469e-88eb-44a996062ca6 as it has an incoming, in-progress migration 1a1b4cf2-af55-4a17-89cc-dfdd5bdf8480. Migration status is finished {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 15:34:53 user nova-compute[74788]: INFO nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating resource usage from migration 1a1b4cf2-af55-4a17-89cc-dfdd5bdf8480
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e824084b-42b2-4833-b14f-958ec30156a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Migration 1a1b4cf2-af55-4a17-89cc-dfdd5bdf8480 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:34:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:34:54 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:34:54 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:34:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:34:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGhuxABN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:34:57 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:34:57 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:34:57 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:34:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b6aff-3f29-4670-8d78-3f0bd205b24e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:34:57 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2bcf64-154c-4343-aa7e-8491f06daf0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d] added
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[19797ad7-790a-4f7f-afd7-b8f74a6d019d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d04c652-e5b8-43dc-968e-6a15b148234a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGhuxABN {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGhuxABN" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9645203e-5b80-4fec-a859-cb30c94700d2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jGhuxABN'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a4d5f-ebe2-4bab-a2cb-c279b5cf89b8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb5b13-c584-41b3-a74e-9f5163ded635]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf60a5-8f22-4ee3-b7a4-d5bccc138493]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260]
Nov 08 15:34:58 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260] successful.
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab748f57-5306-42dd-8b24-de4659fafe03]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a3a09f-3432-41fd-a1df-8ec06df1e9de]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:34:58 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:34:58 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[39125e40-2926-4209-a0f0-7976cc044464]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGhuxABN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26433666132336636', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433666132336636', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:34:59 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:34:59 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:34:59 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:34:59 user nova-compute[74788]:   <serial>a6d4669f-62eb-42b9-800d-1fc3ad18202d</serial>
Nov 08 15:34:59 user nova-compute[74788]: </disk>
Nov 08 15:34:59 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:64:8d:02, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-76323df8-9b0c-4862-ab5d-19340a051a21 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.673s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing instance network info cache due to event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:34:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:00 user nova-compute[74788]: INFO nova.compute.manager [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Detaching volume fa01f789-444d-4180-ad71-41be44840d57
Nov 08 15:35:00 user nova-compute[74788]: INFO nova.virt.block_device [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Attempting to driver detach volume fa01f789-444d-4180-ad71-41be44840d57 from mountpoint /dev/vdb
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Attempting to detach device vdb from instance e824084b-42b2-4833-b14f-958ec30156a8 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:35:00 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:35:00 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:35:00 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:35:00 user nova-compute[74788]:   <serial>fa01f789-444d-4180-ad71-41be44840d57</serial>
Nov 08 15:35:00 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:35:00 user nova-compute[74788]: </disk>
Nov 08 15:35:00 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:35:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully detached device vdb from instance e824084b-42b2-4833-b14f-958ec30156a8 from the persistent domain config.
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e824084b-42b2-4833-b14f-958ec30156a8 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:35:00 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:35:00 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:35:00 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:35:00 user nova-compute[74788]:   <serial>fa01f789-444d-4180-ad71-41be44840d57</serial>
Nov 08 15:35:00 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:35:00 user nova-compute[74788]: </disk>
Nov 08 15:35:00 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updated VIF entry in instance network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f2bd0c9-3db8-494d-8c54-2a860e0d1c79 req-28b87c90-dac4-47d5-97b5-c748b0169b03 service nova] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:35:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:35:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing instance network info cache due to event network-changed-5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] Acquiring lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] Acquired lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Refreshing network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updated VIF entry in instance network info cache for port 5b2757df-faeb-4fdb-8add-612e784b5195. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [{"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-06a40a33-a898-4378-bfac-b91bec14a6d5 req-0b962826-68b6-47c1-ab40-dd44480f5cf2 service nova] Releasing lock "refresh_cache-e824084b-42b2-4833-b14f-958ec30156a8" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:35:03 user nova-compute[74788]: INFO nova.compute.claims [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Claim successful on node user
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:35:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:35:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.policy [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e567adf9bfe49e58cc73195084c7acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e545713667df40d8b632db43b4f991b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:35:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Creating image(s)
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk 1073741824" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Successfully created port: a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Cannot resize image /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Ensure instance console log exists: /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Successfully updated port: a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquired lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-changed-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Refreshing instance network info cache due to event network-changed-a0571f55-3c58-4e20-99f6-a85b1bba9a0d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] Acquiring lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updating instance_info_cache with network_info: [{"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Releasing lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Instance network_info: |[{"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] Acquired lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.neutron [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Refreshing network info cache for port a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Start _get_guest_xml network_info=[{"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:35:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-534698045',display_name='tempest-AttachVolumeNegativeTest-server-534698045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-534698045',id=35,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ja1DdbhOxrXB+ldG4pZGiQOM/x+IteOGHWKvNdTEcgD7z+UOY7a4gc+u4smhAx0lXr9+jf9L2tElV8tQgYst+UvZKsyk6z5VbEXbD9JdZZ6bukyIgcRZrxPWcnJGDhw==',key_name='tempest-keypair-602540386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-w0ubxioh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=d8c845a2-2a03-4459-a2e1-07f5955812fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'pci_devices' on Instance uuid d8c845a2-2a03-4459-a2e1-07f5955812fe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:35:05 user nova-compute[74788]:   <uuid>d8c845a2-2a03-4459-a2e1-07f5955812fe</uuid>
Nov 08 15:35:05 user nova-compute[74788]:   <name>instance-00000023</name>
Nov 08 15:35:05 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:35:05 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:35:05 user nova-compute[74788]:   <metadata>
Nov 08 15:35:05 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:35:05 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeNegativeTest-server-534698045</nova:name>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:35:05</nova:creationTime>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:35:05 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:35:05 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:owner>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:user uuid="2e567adf9bfe49e58cc73195084c7acf">tempest-AttachVolumeNegativeTest-1449712443-project-member</nova:user>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:project uuid="e545713667df40d8b632db43b4f991b4">tempest-AttachVolumeNegativeTest-1449712443</nova:project>
Nov 08 15:35:05 user nova-compute[74788]:       </nova:owner>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:35:05 user nova-compute[74788]:       <nova:ports>
Nov 08 15:35:05 user nova-compute[74788]:         <nova:port uuid="a0571f55-3c58-4e20-99f6-a85b1bba9a0d">
Nov 08 15:35:05 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 15:35:05 user nova-compute[74788]:         </nova:port>
Nov 08 15:35:05 user nova-compute[74788]:       </nova:ports>
Nov 08 15:35:05 user nova-compute[74788]:     </nova:instance>
Nov 08 15:35:05 user nova-compute[74788]:   </metadata>
Nov 08 15:35:05 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:35:05 user nova-compute[74788]:     <system>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="serial">d8c845a2-2a03-4459-a2e1-07f5955812fe</entry>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="uuid">d8c845a2-2a03-4459-a2e1-07f5955812fe</entry>
Nov 08 15:35:05 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:35:05 user nova-compute[74788]:     </system>
Nov 08 15:35:05 user nova-compute[74788]:   </sysinfo>
Nov 08 15:35:05 user nova-compute[74788]:   <os>
Nov 08 15:35:05 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:35:05 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:35:05 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:35:05 user nova-compute[74788]:   </os>
Nov 08 15:35:05 user nova-compute[74788]:   <features>
Nov 08 15:35:05 user nova-compute[74788]:     <acpi/>
Nov 08 15:35:05 user nova-compute[74788]:     <apic/>
Nov 08 15:35:05 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:35:05 user nova-compute[74788]:   </features>
Nov 08 15:35:05 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:35:05 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:35:05 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:35:05 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:35:05 user nova-compute[74788]:   </clock>
Nov 08 15:35:05 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:35:05 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:35:05 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:35:05 user nova-compute[74788]:   </cpu>
Nov 08 15:35:05 user nova-compute[74788]:   <devices>
Nov 08 15:35:05 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:35:05 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:35:05 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk"/>
Nov 08 15:35:05 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:35:05 user nova-compute[74788]:     </disk>
Nov 08 15:35:05 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:35:05 user nova-compute[74788]:       <mac address="fa:16:3e:d9:4d:fb"/>
Nov 08 15:35:05 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:35:05 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:35:05 user nova-compute[74788]:       <target dev="tapa0571f55-3c"/>
Nov 08 15:35:05 user nova-compute[74788]:     </interface>
Nov 08 15:35:05 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:35:05 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/console.log" append="off"/>
Nov 08 15:35:05 user nova-compute[74788]:     </serial>
Nov 08 15:35:05 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:35:05 user nova-compute[74788]:     <video>
Nov 08 15:35:05 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:35:05 user nova-compute[74788]:     </video>
Nov 08 15:35:05 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:35:05 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:35:05 user nova-compute[74788]:     </rng>
Nov 08 15:35:05 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:35:05 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:35:05 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:35:05 user nova-compute[74788]:     </memballoon>
Nov 08 15:35:05 user nova-compute[74788]:   </devices>
Nov 08 15:35:05 user nova-compute[74788]: </domain>
Nov 08 15:35:05 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-534698045',display_name='tempest-AttachVolumeNegativeTest-server-534698045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-534698045',id=35,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ja1DdbhOxrXB+ldG4pZGiQOM/x+IteOGHWKvNdTEcgD7z+UOY7a4gc+u4smhAx0lXr9+jf9L2tElV8tQgYst+UvZKsyk6z5VbEXbD9JdZZ6bukyIgcRZrxPWcnJGDhw==',key_name='tempest-keypair-602540386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-w0ubxioh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=d8c845a2-2a03-4459-a2e1-07f5955812fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG os_vif [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e22ee6ac-1b19-5693-adb5-b03cbe39994f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0571f55-3c, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0571f55-3c, col_values=(('qos', UUID('4ba08955-5873-41e4-93ed-9b2964aba0d8')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0571f55-3c, col_values=(('external_ids', {'iface-id': 'a0571f55-3c58-4e20-99f6-a85b1bba9a0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:4d:fb', 'vm-uuid': 'd8c845a2-2a03-4459-a2e1-07f5955812fe'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:06 user nova-compute[74788]: INFO os_vif [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c')
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:d9:4d:fb, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updated VIF entry in instance network info cache for port a0571f55-3c58-4e20-99f6-a85b1bba9a0d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updating instance_info_cache with network_info: [{"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7634030d-e2a4-4820-a10f-6816edd457d6 req-7782e34d-45a5-41d8-a954-5290a78cad3a service nova] Releasing lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] No waiting events found dispatching network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:35:07 user nova-compute[74788]: WARNING nova.compute.manager [req-840cccb7-2234-446e-bce9-df6b62bd2b44 req-deff8e62-f2ac-431f-9108-083ba496dc7c service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received unexpected event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d for instance with vm_state building and task_state spawning.
Nov 08 15:35:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:35:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Instance spawned successfully.
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:35:09 user nova-compute[74788]: INFO nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] No waiting events found dispatching network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:35:09 user nova-compute[74788]: WARNING nova.compute.manager [req-7e7f2f24-4da5-4ceb-bac9-66c6f164ac27 req-3c6aa41a-8574-4333-b403-b2eaaace1417 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received unexpected event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d for instance with vm_state building and task_state spawning.
Nov 08 15:35:09 user nova-compute[74788]: INFO nova.compute.manager [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Took 6.23 seconds to build instance.
Nov 08 15:35:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-07af8dfc-763b-47d3-89f2-88ed9ef8ae5c tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.362s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:21 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e824084b-42b2-4833-b14f-958ec30156a8 is timed out.
Nov 08 15:35:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully detached device vdb from instance e824084b-42b2-4833-b14f-958ec30156a8 from the live domain config.
Nov 08 15:35:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBTLXlwi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:35:21 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c8f8b3-731f-4258-aadc-df625e9aa3b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:35:21 user nova-compute[74788]: No targets found.
Nov 08 15:35:21 user nova-compute[74788]: iSNS:
Nov 08 15:35:21 user nova-compute[74788]: No targets found.
Nov 08 15:35:21 user nova-compute[74788]: STATIC:
Nov 08 15:35:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:35:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:35:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:35:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57
Nov 08 15:35:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:35:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:35:21 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d
Nov 08 15:35:21 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:35:21 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:35:21 user nova-compute[74788]: FIRMWARE:
Nov 08 15:35:21 user nova-compute[74788]: No targets found.
Nov 08 15:35:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:35:21 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:35:21 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3574c4-4bc7-4298-8749-23f1031f2a32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35071b6-5e79-4722-857a-f2cbaa667cb0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:35:21 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:35:21 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:35:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 (non-flash)
Nov 08 15:35:21 user nova-compute[74788]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:35:21 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:35:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c643c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c29b0-cf81-4344-9578-0e7a2eefeac0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511ca6a-69ed-4b85-8273-45961f2457f6]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfce0d47-4f6f-43e4-aae9-d24d89e1c726]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f7787-606a-4e43-84e2-8fbf4bce0bd0]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a882bc-9d14-4eaf-b68a-5efee4c6decf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[488aec35-ada3-4792-9711-6a3a8042b937]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260]
Nov 08 15:35:21 user nova-compute[74788]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57, portal: 172.16.0.220,3260] successful.
Nov 08 15:35:21 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa01f789-444d-4180-ad71-41be44840d57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b5a241-4fdd-49d2-aa9d-3c813cbaac31]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] <== disconnect_volume: return (300ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:35:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:35:22 user nova-compute[74788]: DEBUG nova.objects.instance [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'flavor' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37dc9c79-df81-43ce-8786-eb397dcd9efa tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.988s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:35:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:47 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Going to confirm migration 2 {{(pid=74788) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquired lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'info_cache' on Instance uuid c8c68545-480e-469e-88eb-44a996062ca6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [{"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Releasing lock "refresh_cache-c8c68545-480e-469e-88eb-44a996062ca6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'migration_context' on Instance uuid c8c68545-480e-469e-88eb-44a996062ca6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG nova.objects.base [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Object Instance<c8c68545-480e-469e-88eb-44a996062ca6> lazy-loaded attributes: info_cache,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.354s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:49 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Deleted allocation for migration 1a1b4cf2-af55-4a17-89cc-dfdd5bdf8480
Nov 08 15:35:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1aead7e2-3d2d-456f-afda-1e8997c33838 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.246s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:35:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "e824084b-42b2-4833-b14f-958ec30156a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:50 user nova-compute[74788]: INFO nova.compute.manager [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Terminating instance
Nov 08 15:35:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:50 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Instance destroyed successfully.
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid e824084b-42b2-4833-b14f-958ec30156a8 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-973903588',display_name='tempest-ServerRescueNegativeTestJSON-server-973903588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-973903588',id=30,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3iVkBxwB1fgnj77Aiv07aPCz6xIpN4Tg3N6BHAMkCNe3ydN1cAAo3lCiJ0k5smk1mIni4gip8wWrqcxJRGL9jCepn1Y9xEZUBrHIcCEhlx9MXIHjMU0DhEHu9j5UYZ5w==',key_name='tempest-keypair-1459817029',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-t3yqqs28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=e824084b-42b2-4833-b14f-958ec30156a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "5b2757df-faeb-4fdb-8add-612e784b5195", "address": "fa:16:3e:b5:84:2f", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2757df-fa", "ovs_interfaceid": "5b2757df-faeb-4fdb-8add-612e784b5195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG os_vif [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2757df-fa, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfbc8997-bbc3-450a-b4c4-7bc97bc678dc) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:51 user nova-compute[74788]: INFO os_vif [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:84:2f,bridge_name='br-int',has_traffic_filtering=True,id=5b2757df-faeb-4fdb-8add-612e784b5195,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2757df-fa')
Nov 08 15:35:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Deleting instance files /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8_del
Nov 08 15:35:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Deletion of /opt/stack/data/nova/instances/e824084b-42b2-4833-b14f-958ec30156a8_del complete
Nov 08 15:35:51 user nova-compute[74788]: INFO nova.compute.manager [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 15:35:51 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:35:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid 'e824084b-42b2-4833-b14f-958ec30156a8' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e824084b-42b2-4833-b14f-958ec30156a8' (instance-0000001e)
Nov 08 15:35:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-b65d18ef-d72b-441f-bc20-120c420c6957 req-2ba401b9-47d5-46a0-b94c-a4b487889c51 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Received event network-vif-deleted-5b2757df-faeb-4fdb-8add-612e784b5195 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:52 user nova-compute[74788]: INFO nova.compute.manager [req-b65d18ef-d72b-441f-bc20-120c420c6957 req-2ba401b9-47d5-46a0-b94c-a4b487889c51 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Neutron deleted interface 5b2757df-faeb-4fdb-8add-612e784b5195; detaching it from the instance and deleting it from the info cache
Nov 08 15:35:52 user nova-compute[74788]: DEBUG nova.network.neutron [req-b65d18ef-d72b-441f-bc20-120c420c6957 req-2ba401b9-47d5-46a0-b94c-a4b487889c51 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:52 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Took 0.97 seconds to deallocate network for instance.
Nov 08 15:35:52 user nova-compute[74788]: DEBUG nova.compute.manager [req-b65d18ef-d72b-441f-bc20-120c420c6957 req-2ba401b9-47d5-46a0-b94c-a4b487889c51 service nova] [instance: e824084b-42b2-4833-b14f-958ec30156a8] Detach interface failed, port_id=5b2757df-faeb-4fdb-8add-612e784b5195, reason: Instance e824084b-42b2-4833-b14f-958ec30156a8 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:53 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Deleted allocations for instance e824084b-42b2-4833-b14f-958ec30156a8
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f66-d8b0-4170-adcf-2a9051044509 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "e824084b-42b2-4833-b14f-958ec30156a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:54 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:54 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=25.261188507080078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d8c845a2-2a03-4459-a2e1-07f5955812fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:35:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.086s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:35:55 user nova-compute[74788]: INFO nova.compute.claims [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Claim successful on node user
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:35:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.policy [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ba57a416dde4ac6a614772b697f6a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a955c40887b64d539fd32b4b75fb31a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:35:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Creating image(s)
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "/opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "/opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk 1073741824" returned: 0 in 0.066s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Successfully created port: 6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Cannot resize image /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Ensure instance console log exists: /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Successfully updated port: 6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquired lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-changed-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Refreshing instance network info cache due to event network-changed-6aa40cd4-6c7b-450f-b712-9c4806bcda8f. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] Acquiring lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Updating instance_info_cache with network_info: [{"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Releasing lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Instance network_info: |[{"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] Acquired lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Refreshing network info cache for port 6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Start _get_guest_xml network_info=[{"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:35:57 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:57 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-632164861',display_name='tempest-VolumesActionsTest-instance-632164861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-632164861',id=36,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a955c40887b64d539fd32b4b75fb31a3',ramdisk_id='',reservation_id='r-l11jv8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-952726342',owner_user_name='tempest-VolumesActionsTest-952726342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:35:56Z,user_data=None,user_id='3ba57a416dde4ac6a614772b697f6a1d',uuid=3e53b5b0-afc4-448e-b19a-4401e7a6bde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converting VIF {"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:35:57 user nova-compute[74788]:   <uuid>3e53b5b0-afc4-448e-b19a-4401e7a6bde2</uuid>
Nov 08 15:35:57 user nova-compute[74788]:   <name>instance-00000024</name>
Nov 08 15:35:57 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:35:57 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:35:57 user nova-compute[74788]:   <metadata>
Nov 08 15:35:57 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:35:57 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:name>tempest-VolumesActionsTest-instance-632164861</nova:name>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:35:57</nova:creationTime>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:35:57 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:35:57 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:owner>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:user uuid="3ba57a416dde4ac6a614772b697f6a1d">tempest-VolumesActionsTest-952726342-project-member</nova:user>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:project uuid="a955c40887b64d539fd32b4b75fb31a3">tempest-VolumesActionsTest-952726342</nova:project>
Nov 08 15:35:57 user nova-compute[74788]:       </nova:owner>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:35:57 user nova-compute[74788]:       <nova:ports>
Nov 08 15:35:57 user nova-compute[74788]:         <nova:port uuid="6aa40cd4-6c7b-450f-b712-9c4806bcda8f">
Nov 08 15:35:57 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 15:35:57 user nova-compute[74788]:         </nova:port>
Nov 08 15:35:57 user nova-compute[74788]:       </nova:ports>
Nov 08 15:35:57 user nova-compute[74788]:     </nova:instance>
Nov 08 15:35:57 user nova-compute[74788]:   </metadata>
Nov 08 15:35:57 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:35:57 user nova-compute[74788]:     <system>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="serial">3e53b5b0-afc4-448e-b19a-4401e7a6bde2</entry>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="uuid">3e53b5b0-afc4-448e-b19a-4401e7a6bde2</entry>
Nov 08 15:35:57 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:35:57 user nova-compute[74788]:     </system>
Nov 08 15:35:57 user nova-compute[74788]:   </sysinfo>
Nov 08 15:35:57 user nova-compute[74788]:   <os>
Nov 08 15:35:57 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:35:57 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:35:57 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:35:57 user nova-compute[74788]:   </os>
Nov 08 15:35:57 user nova-compute[74788]:   <features>
Nov 08 15:35:57 user nova-compute[74788]:     <acpi/>
Nov 08 15:35:57 user nova-compute[74788]:     <apic/>
Nov 08 15:35:57 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:35:57 user nova-compute[74788]:   </features>
Nov 08 15:35:57 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:35:57 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:35:57 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:35:57 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:35:57 user nova-compute[74788]:   </clock>
Nov 08 15:35:57 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:35:57 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:35:57 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:35:57 user nova-compute[74788]:   </cpu>
Nov 08 15:35:57 user nova-compute[74788]:   <devices>
Nov 08 15:35:57 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:35:57 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:35:57 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk"/>
Nov 08 15:35:57 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:35:57 user nova-compute[74788]:     </disk>
Nov 08 15:35:57 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:35:57 user nova-compute[74788]:       <mac address="fa:16:3e:df:63:5f"/>
Nov 08 15:35:57 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:35:57 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:35:57 user nova-compute[74788]:       <target dev="tap6aa40cd4-6c"/>
Nov 08 15:35:57 user nova-compute[74788]:     </interface>
Nov 08 15:35:57 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:35:57 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/console.log" append="off"/>
Nov 08 15:35:57 user nova-compute[74788]:     </serial>
Nov 08 15:35:57 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:35:57 user nova-compute[74788]:     <video>
Nov 08 15:35:57 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:35:57 user nova-compute[74788]:     </video>
Nov 08 15:35:57 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:35:57 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:35:57 user nova-compute[74788]:     </rng>
Nov 08 15:35:57 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:35:57 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:35:57 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:35:57 user nova-compute[74788]:     </memballoon>
Nov 08 15:35:57 user nova-compute[74788]:   </devices>
Nov 08 15:35:57 user nova-compute[74788]: </domain>
Nov 08 15:35:57 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-632164861',display_name='tempest-VolumesActionsTest-instance-632164861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-632164861',id=36,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a955c40887b64d539fd32b4b75fb31a3',ramdisk_id='',reservation_id='r-l11jv8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-952726342',owner_user_name='tempest-VolumesActionsTest-952726342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:35:56Z,user_data=None,user_id='3ba57a416dde4ac6a614772b697f6a1d',uuid=3e53b5b0-afc4-448e-b19a-4401e7a6bde2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converting VIF {"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG os_vif [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68d36a3e-6229-53ef-8359-d5672e4ae28b', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aa40cd4-6c, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6aa40cd4-6c, col_values=(('qos', UUID('bca6c8ff-4d00-4a5e-bd60-a786e2fab2c5')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6aa40cd4-6c, col_values=(('external_ids', {'iface-id': '6aa40cd4-6c7b-450f-b712-9c4806bcda8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:63:5f', 'vm-uuid': '3e53b5b0-afc4-448e-b19a-4401e7a6bde2'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:57 user nova-compute[74788]: INFO os_vif [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c')
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:35:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] No VIF found with MAC fa:16:3e:df:63:5f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:35:58 user nova-compute[74788]: DEBUG nova.network.neutron [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Updated VIF entry in instance network info cache for port 6aa40cd4-6c7b-450f-b712-9c4806bcda8f. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:35:58 user nova-compute[74788]: DEBUG nova.network.neutron [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Updating instance_info_cache with network_info: [{"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:35:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f19e6491-9d23-4660-b770-5d8ea756c089 req-d31cc7f0-7897-4930-b056-2480a1b3ead7 service nova] Releasing lock "refresh_cache-3e53b5b0-afc4-448e-b19a-4401e7a6bde2" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:35:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] No waiting events found dispatching network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:35:59 user nova-compute[74788]: WARNING nova.compute.manager [req-4418c80a-b340-42b7-a611-8e0865a0d706 req-656846c4-999f-4939-8b08-7746ba9bf44c service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received unexpected event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f for instance with vm_state building and task_state spawning.
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:35:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:36:01 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Instance spawned successfully.
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:01 user nova-compute[74788]: INFO nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] No waiting events found dispatching network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:36:01 user nova-compute[74788]: WARNING nova.compute.manager [req-bdcaaabc-e6b3-4e87-a995-c257c630ffe4 req-c80f55f4-3fd2-4b81-8b2b-e358fb0c675a service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received unexpected event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f for instance with vm_state building and task_state spawning.
Nov 08 15:36:01 user nova-compute[74788]: INFO nova.compute.manager [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Took 6.40 seconds to build instance.
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c328967a-d388-496f-b1ff-84afa9a08f9a tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.504s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:19 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:36:19 user nova-compute[74788]: INFO nova.compute.claims [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Claim successful on node user
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:36:20 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.policy [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:36:20 user nova-compute[74788]: INFO nova.virt.block_device [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Booting with volume d83198e6-295a-44a8-85ff-5c4446ff8c15 at /dev/vda
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.utils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6fd5f2-1e9b-4770-91c9-6951087d8f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b87cd7-bbaa-4554-b852-938c6b8ced43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c44cb04-ebe4-4203-89b0-d173c0f41466]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[243dcfe9-0d43-4cb8-8139-4ea20b01e67b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:36:20 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:36:20 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fbea8-e9c8-4ed2-8fda-769d979dfac7]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG os_brick.utils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating existing volume attachment record: d37117b4-82be-40be-9c08-f83a8c0beec9 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:36:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Successfully created port: c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Successfully updated port: c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-changed-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Refreshing instance network info cache due to event network-changed-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] Acquiring lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating instance_info_cache with network_info: [{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Instance network_info: |[{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] Acquired lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:36:21 user nova-compute[74788]: DEBUG nova.network.neutron [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Refreshing network info cache for port c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:36:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updated VIF entry in instance network info cache for port c25dfc3a-1d0e-40ef-956c-2aa6e77941f4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:36:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating instance_info_cache with network_info: [{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:36:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cbba7871-cdb0-49f4-9241-667f265121f6 req-a37fb681-076b-46e8-9318-fab124ad5b51 service nova] Releasing lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:36:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:36:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Creating image(s)
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Ensure instance console log exists: /opt/stack/data/nova/instances/c54aa85a-14a7-4971-8037-59f89dec0b3e/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Start _get_guest_xml network_info=[{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pokBafeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c54aa85a-14a7-4971-8037-59f89dec0b3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd83198e6-295a-44a8-85ff-5c4446ff8c15', 'serial': 'd83198e6-295a-44a8-85ff-5c4446ff8c15'}, 'attachment_id': 'd37117b4-82be-40be-9c08-f83a8c0beec9', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:36:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:36:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pokBafeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:36:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:36:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:36:42 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98789cd-7166-4a3a-a847-55a5a6020e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:36:42 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac4dd0-eaa4-479b-b754-bf2e2df00c86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15] added
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3935aeef-e60e-492f-8fe5-e4836e57ed56]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257f0d9-dee4-4658-9a0c-770ceef79329]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pokBafeA {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pokBafeA" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9c8073-dc5a-4409-a303-69df58c3e5c1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pokBafeA'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67591cd-2e89-4b52-95a3-57ca0347b647]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0f13f-3209-4fa4-9dd6-77adf95b2f3d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bee1af-335f-456c-b6c4-5beec5732a27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260]
Nov 08 15:36:42 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260] successful.
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[354880ee-0edb-4816-88b9-e8f14d4b8568]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd821f0-b1a8-46cd-991e-8ac6c47aa58f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:36:42 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:36:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:36:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eca322-df05-4193-8a7e-a3b772601c7b]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:36:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:36:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pokBafeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23062323837623632', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062323837623632', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1983285058',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaU+TCCH0OLDCPZsVpuSVAXLwV9w99PuTiODCBxoNZsnT/AA9hxI3ThK31aIeWAkHfyjgKZK2DFgPv+weH52rwJmoZAKIuE4ieEvnsW1TSukjGuPR/pL/1//IXgRiDE4Q==',key_name='tempest-keypair-1159745895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-rm3lgwv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9655d103734d485691fe3d82e4e68032',uuid=c54aa85a-14a7-4971-8037-59f89dec0b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'pci_devices' on Instance uuid c54aa85a-14a7-4971-8037-59f89dec0b3e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:36:44 user nova-compute[74788]:   <uuid>c54aa85a-14a7-4971-8037-59f89dec0b3e</uuid>
Nov 08 15:36:44 user nova-compute[74788]:   <name>instance-00000025</name>
Nov 08 15:36:44 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:36:44 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:36:44 user nova-compute[74788]:   <metadata>
Nov 08 15:36:44 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:36:44 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:36:44 user nova-compute[74788]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1983285058</nova:name>
Nov 08 15:36:44 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:36:42</nova:creationTime>
Nov 08 15:36:44 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:36:44 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:36:44 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:36:44 user nova-compute[74788]:       <nova:owner>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:user uuid="9655d103734d485691fe3d82e4e68032">tempest-TestVolumeBootPattern-1548248568-project-member</nova:user>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:project uuid="ef632441d171499280801b367697b620">tempest-TestVolumeBootPattern-1548248568</nova:project>
Nov 08 15:36:44 user nova-compute[74788]:       </nova:owner>
Nov 08 15:36:44 user nova-compute[74788]:       <nova:ports>
Nov 08 15:36:44 user nova-compute[74788]:         <nova:port uuid="c25dfc3a-1d0e-40ef-956c-2aa6e77941f4">
Nov 08 15:36:44 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 15:36:44 user nova-compute[74788]:         </nova:port>
Nov 08 15:36:44 user nova-compute[74788]:       </nova:ports>
Nov 08 15:36:44 user nova-compute[74788]:     </nova:instance>
Nov 08 15:36:44 user nova-compute[74788]:   </metadata>
Nov 08 15:36:44 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:36:44 user nova-compute[74788]:     <system>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="serial">c54aa85a-14a7-4971-8037-59f89dec0b3e</entry>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="uuid">c54aa85a-14a7-4971-8037-59f89dec0b3e</entry>
Nov 08 15:36:44 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:36:44 user nova-compute[74788]:     </system>
Nov 08 15:36:44 user nova-compute[74788]:   </sysinfo>
Nov 08 15:36:44 user nova-compute[74788]:   <os>
Nov 08 15:36:44 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:36:44 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:36:44 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:36:44 user nova-compute[74788]:   </os>
Nov 08 15:36:44 user nova-compute[74788]:   <features>
Nov 08 15:36:44 user nova-compute[74788]:     <acpi/>
Nov 08 15:36:44 user nova-compute[74788]:     <apic/>
Nov 08 15:36:44 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:36:44 user nova-compute[74788]:   </features>
Nov 08 15:36:44 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:36:44 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:36:44 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:36:44 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:36:44 user nova-compute[74788]:   </clock>
Nov 08 15:36:44 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:36:44 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:36:44 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:36:44 user nova-compute[74788]:   </cpu>
Nov 08 15:36:44 user nova-compute[74788]:   <devices>
Nov 08 15:36:44 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:36:44 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:36:44 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:36:44 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:36:44 user nova-compute[74788]:       <serial>d83198e6-295a-44a8-85ff-5c4446ff8c15</serial>
Nov 08 15:36:44 user nova-compute[74788]:     </disk>
Nov 08 15:36:44 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:36:44 user nova-compute[74788]:       <mac address="fa:16:3e:11:4a:7d"/>
Nov 08 15:36:44 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:36:44 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:36:44 user nova-compute[74788]:       <target dev="tapc25dfc3a-1d"/>
Nov 08 15:36:44 user nova-compute[74788]:     </interface>
Nov 08 15:36:44 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:36:44 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/c54aa85a-14a7-4971-8037-59f89dec0b3e/console.log" append="off"/>
Nov 08 15:36:44 user nova-compute[74788]:     </serial>
Nov 08 15:36:44 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:36:44 user nova-compute[74788]:     <video>
Nov 08 15:36:44 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:36:44 user nova-compute[74788]:     </video>
Nov 08 15:36:44 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:36:44 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:36:44 user nova-compute[74788]:     </rng>
Nov 08 15:36:44 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:36:44 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:36:44 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:36:44 user nova-compute[74788]:     </memballoon>
Nov 08 15:36:44 user nova-compute[74788]:   </devices>
Nov 08 15:36:44 user nova-compute[74788]: </domain>
Nov 08 15:36:44 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1983285058',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaU+TCCH0OLDCPZsVpuSVAXLwV9w99PuTiODCBxoNZsnT/AA9hxI3ThK31aIeWAkHfyjgKZK2DFgPv+weH52rwJmoZAKIuE4ieEvnsW1TSukjGuPR/pL/1//IXgRiDE4Q==',key_name='tempest-keypair-1159745895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-rm3lgwv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9655d103734d485691fe3d82e4e68032',uuid=c54aa85a-14a7-4971-8037-59f89dec0b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG os_vif [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e545c681-8b48-500a-9613-be2370a65ebb', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc25dfc3a-1d, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc25dfc3a-1d, col_values=(('qos', UUID('f3a9dcfa-6c42-4570-bd51-03e0af454502')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc25dfc3a-1d, col_values=(('external_ids', {'iface-id': 'c25dfc3a-1d0e-40ef-956c-2aa6e77941f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:4a:7d', 'vm-uuid': 'c54aa85a-14a7-4971-8037-59f89dec0b3e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:44 user nova-compute[74788]: INFO os_vif [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d')
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:36:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No VIF found with MAC fa:16:3e:11:4a:7d, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] No waiting events found dispatching network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:36:45 user nova-compute[74788]: WARNING nova.compute.manager [req-3f879971-dc32-4588-9016-23f350e104da req-a8dc9c55-8cab-4d87-a356-4a21da2edefc service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received unexpected event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 for instance with vm_state building and task_state spawning.
Nov 08 15:36:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:36:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Instance spawned successfully.
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:36:47 user nova-compute[74788]: INFO nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] No waiting events found dispatching network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:36:47 user nova-compute[74788]: WARNING nova.compute.manager [req-2c0b6c8e-cb68-4380-8ed0-0ff8afb4d228 req-c1ecac10-395c-4f26-9501-d814ee586f8a service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received unexpected event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 for instance with vm_state building and task_state spawning.
Nov 08 15:36:47 user nova-compute[74788]: INFO nova.compute.manager [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Took 28.13 seconds to build instance.
Nov 08 15:36:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-6c33285c-85c9-48db-a043-9cca96ee4c14 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.224s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:36:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [{"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-e0c3ad12-7047-4836-9f7b-c80a95aeeac6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:36:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:52 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:53 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:36:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-changed-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Refreshing instance network info cache due to event network-changed-a0571f55-3c58-4e20-99f6-a85b1bba9a0d. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] Acquiring lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] Acquired lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG nova.network.neutron [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Refreshing network info cache for port a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:56 user nova-compute[74788]: INFO nova.compute.manager [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Terminating instance
Nov 08 15:36:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updated VIF entry in instance network info cache for port a0571f55-3c58-4e20-99f6-a85b1bba9a0d. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.network.neutron [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updating instance_info_cache with network_info: [{"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-unplugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] No waiting events found dispatching network-vif-unplugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-ec52d067-6125-4471-a55c-415c18e54317 req-417a6030-fb4e-4174-ba99-589a33bce346 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-unplugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:36:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Instance destroyed successfully.
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.objects.instance [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'resources' on Instance uuid d8c845a2-2a03-4459-a2e1-07f5955812fe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:36:57 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:36:57 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=25.257720947265625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-799290f4-654f-48cd-b540-57eceefde21d req-67b9c8e3-5a7b-4974-9a9f-ad0bb7545d95 service nova] Releasing lock "refresh_cache-d8c845a2-2a03-4459-a2e1-07f5955812fe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-534698045',display_name='tempest-AttachVolumeNegativeTest-server-534698045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-534698045',id=35,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ja1DdbhOxrXB+ldG4pZGiQOM/x+IteOGHWKvNdTEcgD7z+UOY7a4gc+u4smhAx0lXr9+jf9L2tElV8tQgYst+UvZKsyk6z5VbEXbD9JdZZ6bukyIgcRZrxPWcnJGDhw==',key_name='tempest-keypair-602540386',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:35:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-w0ubxioh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=d8c845a2-2a03-4459-a2e1-07f5955812fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "address": "fa:16:3e:d9:4d:fb", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0571f55-3c", "ovs_interfaceid": "a0571f55-3c58-4e20-99f6-a85b1bba9a0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG os_vif [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0571f55-3c, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ba08955-5873-41e4-93ed-9b2964aba0d8) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:57 user nova-compute[74788]: INFO os_vif [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:4d:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0571f55-3c58-4e20-99f6-a85b1bba9a0d,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0571f55-3c')
Nov 08 15:36:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Deleting instance files /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe_del
Nov 08 15:36:57 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Deletion of /opt/stack/data/nova/instances/d8c845a2-2a03-4459-a2e1-07f5955812fe_del complete
Nov 08 15:36:57 user nova-compute[74788]: INFO nova.compute.manager [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance d8c845a2-2a03-4459-a2e1-07f5955812fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c54aa85a-14a7-4971-8037-59f89dec0b3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:36:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:36:58 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Took 0.98 seconds to deallocate network for instance.
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-05d17c45-ae10-4bfd-8af4-e76f9bb0464d req-3cf78809-4fb3-43f7-8ad7-00f91aaca87d service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-deleted-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] Acquiring lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] No waiting events found dispatching network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:36:58 user nova-compute[74788]: WARNING nova.compute.manager [req-33805ebe-4929-4429-9494-b2863bf57c22 req-634ac7dd-c784-4550-9d6c-bfc122877757 service nova] [instance: d8c845a2-2a03-4459-a2e1-07f5955812fe] Received unexpected event network-vif-plugged-a0571f55-3c58-4e20-99f6-a85b1bba9a0d for instance with vm_state deleted and task_state None.
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:36:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:36:58 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Deleted allocations for instance d8c845a2-2a03-4459-a2e1-07f5955812fe
Nov 08 15:36:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-94384eaf-1dba-4270-931b-35d581f837ae tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "d8c845a2-2a03-4459-a2e1-07f5955812fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.866s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:37:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:04 user nova-compute[74788]: INFO nova.compute.manager [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Terminating instance
Nov 08 15:37:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-ffd800b8-256d-4393-8869-91894ebe43aa req-c11d229c-d099-46dd-9295-ee46ccf453f9 service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-unplugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Instance destroyed successfully.
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid 6a9abf8f-0442-45c7-9d91-2a1c062437d7 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020246904',display_name='tempest-ServerRescueNegativeTestJSON-server-2020246904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020246904',id=20,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-0m204bnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:22:15Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=6a9abf8f-0442-45c7-9d91-2a1c062437d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "eaae088b-d477-4248-a868-fe6d7545d647", "address": "fa:16:3e:f4:99:4e", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaae088b-d4", "ovs_interfaceid": "eaae088b-d477-4248-a868-fe6d7545d647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG os_vif [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaae088b-d4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8c3d875-7269-4b9a-93e3-e03ceb707fd9) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:05 user nova-compute[74788]: INFO os_vif [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:99:4e,bridge_name='br-int',has_traffic_filtering=True,id=eaae088b-d477-4248-a868-fe6d7545d647,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaae088b-d4')
Nov 08 15:37:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Deleting instance files /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7_del
Nov 08 15:37:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Deletion of /opt/stack/data/nova/instances/6a9abf8f-0442-45c7-9d91-2a1c062437d7_del complete
Nov 08 15:37:05 user nova-compute[74788]: INFO nova.compute.manager [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 08 15:37:05 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:37:05 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:37:06 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Took 1.07 seconds to deallocate network for instance.
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-4287f8b0-71db-41a3-8842-f030f18646ce req-aa50bd42-b9be-418d-9ef0-b6426268adac service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-deleted-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:06 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Deleted allocations for instance 6a9abf8f-0442-45c7-9d91-2a1c062437d7
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f3ac7d67-9c22-46bc-b72c-a01f9e16a07f tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] Acquiring lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] Lock "6a9abf8f-0442-45c7-9d91-2a1c062437d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] No waiting events found dispatching network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:37:06 user nova-compute[74788]: WARNING nova.compute.manager [req-c119d1be-6ee2-4143-9080-326c96d1a73f req-df947050-3a21-484e-a03c-5d353df63afa service nova] [instance: 6a9abf8f-0442-45c7-9d91-2a1c062437d7] Received unexpected event network-vif-plugged-eaae088b-d477-4248-a868-fe6d7545d647 for instance with vm_state deleted and task_state None.
Nov 08 15:37:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:37:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:39 user nova-compute[74788]: INFO nova.compute.manager [None req-a49854d5-2c3d-4edc-be91-db6d43b1d797 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Get console output
Nov 08 15:37:39 user nova-compute[74788]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 15:37:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:37:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:47 user nova-compute[74788]: INFO nova.compute.manager [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Detaching volume a6d4669f-62eb-42b9-800d-1fc3ad18202d
Nov 08 15:37:47 user nova-compute[74788]: INFO nova.virt.block_device [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Attempting to driver detach volume a6d4669f-62eb-42b9-800d-1fc3ad18202d from mountpoint /dev/vdb
Nov 08 15:37:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Attempting to detach device vdb from instance e7614440-9110-4515-b0bc-4309000d37be from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:37:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:37:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:37:47 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:37:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:37:47 user nova-compute[74788]:   <serial>a6d4669f-62eb-42b9-800d-1fc3ad18202d</serial>
Nov 08 15:37:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:37:47 user nova-compute[74788]: </disk>
Nov 08 15:37:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:37:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance e7614440-9110-4515-b0bc-4309000d37be from the persistent domain config.
Nov 08 15:37:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e7614440-9110-4515-b0bc-4309000d37be from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:37:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:37:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:37:47 user nova-compute[74788]:   <source dev="/dev/sdd"/>
Nov 08 15:37:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:37:47 user nova-compute[74788]:   <serial>a6d4669f-62eb-42b9-800d-1fc3ad18202d</serial>
Nov 08 15:37:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:37:47 user nova-compute[74788]: </disk>
Nov 08 15:37:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:37:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:37:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:50 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [{"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-f4281708-3fc8-480c-9031-62fda80f8940" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:37:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:53 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:55 user nova-compute[74788]: INFO nova.compute.manager [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Terminating instance
Nov 08 15:37:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-9500fc1b-38f0-4d87-b360-c2fb6eb9af9c req-692474b1-c11c-41cb-a163-a1477330f757 service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-unplugged-2222073c-88d5-40e6-8787-45da953d857a for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:37:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:37:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Instance destroyed successfully.
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lazy-loading 'resources' on Instance uuid f4281708-3fc8-480c-9031-62fda80f8940 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:37:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:37:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8275MB free_disk=25.312408447265625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-900878772',display_name='tempest-ServerRescueNegativeTestJSON-server-900878772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-900878772',id=19,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95c4a8437a8a4c54bef06408109fca0a',ramdisk_id='',reservation_id='r-gtlcuzuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-423963337',owner_user_name='tempest-ServerRescueNegativeTestJSON-423963337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:27:04Z,user_data=None,user_id='dfd067f5d7d64fd38a5599a0cf4db51a',uuid=f4281708-3fc8-480c-9031-62fda80f8940,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converting VIF {"id": "2222073c-88d5-40e6-8787-45da953d857a", "address": "fa:16:3e:e3:e4:f6", "network": {"id": "4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1192223274-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95c4a8437a8a4c54bef06408109fca0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2222073c-88", "ovs_interfaceid": "2222073c-88d5-40e6-8787-45da953d857a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG os_vif [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2222073c-88, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=205bad04-d6fb-4050-82a4-189c8ffa14dc) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:37:56 user nova-compute[74788]: INFO os_vif [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=2222073c-88d5-40e6-8787-45da953d857a,network=Network(4ec0d7e2-bcef-4bbd-85a5-d2a6383c2eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2222073c-88')
Nov 08 15:37:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Deleting instance files /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940_del
Nov 08 15:37:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Deletion of /opt/stack/data/nova/instances/f4281708-3fc8-480c-9031-62fda80f8940_del complete
Nov 08 15:37:56 user nova-compute[74788]: INFO nova.compute.manager [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance f4281708-3fc8-480c-9031-62fda80f8940 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e7614440-9110-4515-b0bc-4309000d37be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c8c68545-480e-469e-88eb-44a996062ca6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c54aa85a-14a7-4971-8037-59f89dec0b3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:37:56 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Took 0.51 seconds to deallocate network for instance.
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:57 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Deleted allocations for instance f4281708-3fc8-480c-9031-62fda80f8940
Nov 08 15:37:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2d08f3d-06e0-47f5-bee5-ec3e1bdae8b9 tempest-ServerRescueNegativeTestJSON-423963337 tempest-ServerRescueNegativeTestJSON-423963337-project-member] Lock "f4281708-3fc8-480c-9031-62fda80f8940" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] Acquiring lock "f4281708-3fc8-480c-9031-62fda80f8940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] Lock "f4281708-3fc8-480c-9031-62fda80f8940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:37:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] No waiting events found dispatching network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:37:57 user nova-compute[74788]: WARNING nova.compute.manager [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received unexpected event network-vif-plugged-2222073c-88d5-40e6-8787-45da953d857a for instance with vm_state deleted and task_state None.
Nov 08 15:37:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-d9d7d494-c186-49e9-a7cd-068b21f495f1 req-2c382a49-9a99-4b4b-9814-b091602dcaea service nova] [instance: f4281708-3fc8-480c-9031-62fda80f8940] Received event network-vif-deleted-2222073c-88d5-40e6-8787-45da953d857a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:02 user nova-compute[74788]: INFO nova.compute.manager [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Terminating instance
Nov 08 15:38:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-unplugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] No waiting events found dispatching network-vif-unplugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG nova.compute.manager [req-b2e51346-2ec0-453d-8f37-feb55ec5368f req-cb9500a9-b90f-41b7-970b-5f0846d7a1d1 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-unplugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Instance destroyed successfully.
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lazy-loading 'resources' on Instance uuid 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-632164861',display_name='tempest-VolumesActionsTest-instance-632164861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-632164861',id=36,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a955c40887b64d539fd32b4b75fb31a3',ramdisk_id='',reservation_id='r-l11jv8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-952726342',owner_user_name='tempest-VolumesActionsTest-952726342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:36:01Z,user_data=None,user_id='3ba57a416dde4ac6a614772b697f6a1d',uuid=3e53b5b0-afc4-448e-b19a-4401e7a6bde2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converting VIF {"id": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "address": "fa:16:3e:df:63:5f", "network": {"id": "e53898aa-e680-4e0d-988a-1bb01dcfaac2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842038501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a955c40887b64d539fd32b4b75fb31a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa40cd4-6c", "ovs_interfaceid": "6aa40cd4-6c7b-450f-b712-9c4806bcda8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG os_vif [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aa40cd4-6c, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bca6c8ff-4d00-4a5e-bd60-a786e2fab2c5) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:03 user nova-compute[74788]: INFO os_vif [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:5f,bridge_name='br-int',has_traffic_filtering=True,id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f,network=Network(e53898aa-e680-4e0d-988a-1bb01dcfaac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa40cd4-6c')
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Deleting instance files /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2_del
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Deletion of /opt/stack/data/nova/instances/3e53b5b0-afc4-448e-b19a-4401e7a6bde2_del complete
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.compute.manager [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 08 15:38:03 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Took 0.42 seconds to deallocate network for instance.
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-31424c33-934b-4493-840a-d3c1450d5ef9 req-a774abca-f387-4c28-aab6-2f2d87584d59 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-deleted-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:03 user nova-compute[74788]: INFO nova.compute.manager [req-31424c33-934b-4493-840a-d3c1450d5ef9 req-a774abca-f387-4c28-aab6-2f2d87584d59 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Neutron deleted interface 6aa40cd4-6c7b-450f-b712-9c4806bcda8f; detaching it from the instance and deleting it from the info cache
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.network.neutron [req-31424c33-934b-4493-840a-d3c1450d5ef9 req-a774abca-f387-4c28-aab6-2f2d87584d59 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-31424c33-934b-4493-840a-d3c1450d5ef9 req-a774abca-f387-4c28-aab6-2f2d87584d59 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Detach interface failed, port_id=6aa40cd4-6c7b-450f-b712-9c4806bcda8f, reason: Instance 3e53b5b0-afc4-448e-b19a-4401e7a6bde2 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:04 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Deleted allocations for instance 3e53b5b0-afc4-448e-b19a-4401e7a6bde2
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-fbb00e24-a341-40d9-b4a5-d39bcec1d7d4 tempest-VolumesActionsTest-952726342 tempest-VolumesActionsTest-952726342-project-member] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] Acquiring lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] Lock "3e53b5b0-afc4-448e-b19a-4401e7a6bde2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] No waiting events found dispatching network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:04 user nova-compute[74788]: WARNING nova.compute.manager [req-ea23131e-d146-41ac-baf0-db56f997970e req-a0d96900-bbd4-4fcb-bddb-6a86eadcfbe5 service nova] [instance: 3e53b5b0-afc4-448e-b19a-4401e7a6bde2] Received unexpected event network-vif-plugged-6aa40cd4-6c7b-450f-b712-9c4806bcda8f for instance with vm_state deleted and task_state None.
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid c8c68545-480e-469e-88eb-44a996062ca6 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid c54aa85a-14a7-4971-8037-59f89dec0b3e {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "c8c68545-480e-469e-88eb-44a996062ca6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "c8c68545-480e-469e-88eb-44a996062ca6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e7614440-9110-4515-b0bc-4309000d37be is timed out.
Nov 08 15:38:08 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance e7614440-9110-4515-b0bc-4309000d37be from the live domain config.
Nov 08 15:38:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGhuxABN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:38:08 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80d8201-8072-46c1-957c-d6ff131c2800]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:38:08 user nova-compute[74788]: No targets found.
Nov 08 15:38:08 user nova-compute[74788]: iSNS:
Nov 08 15:38:08 user nova-compute[74788]: No targets found.
Nov 08 15:38:08 user nova-compute[74788]: STATIC:
Nov 08 15:38:08 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:38:08 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:38:08 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:38:08 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15
Nov 08 15:38:08 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:38:08 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:38:08 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d
Nov 08 15:38:08 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:38:08 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:38:08 user nova-compute[74788]: FIRMWARE:
Nov 08 15:38:08 user nova-compute[74788]: No targets found.
Nov 08 15:38:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:38:08 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:38:08 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[221cddf4-2c9b-43c2-985d-4e4984c9e23e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1561185-09ca-41c3-97bd-9d053f651581]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:38:08 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:38:08 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:38:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:38:08 user nova-compute[74788]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d (non-flash)
Nov 08 15:38:08 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:38:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c2fd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[20664d86-04a7-46ba-9577-938642d65ea5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d3bf7-7ba2-4023-9e72-4ad7bb07ab4c]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[539083d4-f857-419f-9bfc-a5a566bda7a6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a626ea7-c5c8-4ba8-8b9e-f69855ed03a8]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f82175-37c8-4929-a6ef-3645331417c8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6fe3e6-8109-4733-81e3-89c76a435a84]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260]
Nov 08 15:38:08 user nova-compute[74788]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d, portal: 172.16.0.220,3260] successful.
Nov 08 15:38:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6d4669f-62eb-42b9-800d-1fc3ad18202d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1b89ae-fba9-4c9a-8ea8-3d3aebb011b0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== disconnect_volume: return (295ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:38:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:38:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:38:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f300b717-5af7-4705-9f01-cdbf65370764 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.398s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-changed-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Refreshing instance network info cache due to event network-changed-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] Acquiring lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] Acquired lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Refreshing network info cache for port c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:38:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:11 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updated VIF entry in instance network info cache for port c25dfc3a-1d0e-40ef-956c-2aa6e77941f4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:38:11 user nova-compute[74788]: DEBUG nova.network.neutron [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating instance_info_cache with network_info: [{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc4e14cd-b605-45c3-8ce2-23f92a31477b req-c54dc15b-1df8-438e-882d-e429f2b0f20c service nova] Releasing lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:38:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:38:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:38:24 user nova-compute[74788]: INFO nova.compute.claims [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Claim successful on node user
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:38:24 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:38:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:38:25 user nova-compute[74788]: INFO nova.virt.block_device [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Booting with volume snapshot 4acc3d49-dfc7-4356-a22c-e6138ced0ec9 at /dev/vda
Nov 08 15:38:25 user nova-compute[74788]: DEBUG nova.policy [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:38:25 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Successfully created port: c935a953-fb5e-42b4-bb8b-366f39cbea50 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Successfully updated port: c935a953-fb5e-42b4-bb8b-366f39cbea50 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Received event network-changed-c935a953-fb5e-42b4-bb8b-366f39cbea50 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Refreshing instance network info cache due to event network-changed-c935a953-fb5e-42b4-bb8b-366f39cbea50. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] Acquiring lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Updating instance_info_cache with network_info: [{"id": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "address": "fa:16:3e:7f:bd:10", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc935a953-fb", "ovs_interfaceid": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Instance network_info: |[{"id": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "address": "fa:16:3e:7f:bd:10", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc935a953-fb", "ovs_interfaceid": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] Acquired lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Refreshing network info cache for port c935a953-fb5e-42b4-bb8b-366f39cbea50 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Updated VIF entry in instance network info cache for port c935a953-fb5e-42b4-bb8b-366f39cbea50. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Updating instance_info_cache with network_info: [{"id": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "address": "fa:16:3e:7f:bd:10", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc935a953-fb", "ovs_interfaceid": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3978ae26-6c22-49f3-8656-4f5b7ce4f746 req-8912d374-fdee-4500-890d-c23c362d55c1 service nova] Releasing lock "refresh_cache-e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:38:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.utils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c466780-217e-4178-a368-a05170b1dbdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766b09c-c185-4098-9e5a-5c62e3a5b50c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b787a2fd-799d-42f6-b445-5584c367b139]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faec711-bc36-44da-b9d1-6f059e36acab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:38:30 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:38:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d50d36f-e0bb-4300-a219-1b74435c3b48]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG os_brick.utils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:38:30 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Updating existing volume attachment record: ef9a9c11-62f6-4a7a-b2c8-3d21963776ec {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:38:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:37 user nova-compute[74788]: INFO nova.compute.manager [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Terminating instance
Nov 08 15:38:37 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-unplugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] No waiting events found dispatching network-vif-unplugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-ee67a09e-aa5f-4f08-89e3-acdc5b1b06cd req-9967911a-a871-4cbd-b040-a1da26f949f8 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-unplugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] Instance destroyed successfully.
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'resources' on Instance uuid e7614440-9110-4515-b0bc-4309000d37be {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1536786455',display_name='tempest-AttachVolumeNegativeTest-server-1536786455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1536786455',id=33,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNajLHTwF47BSYASJ8o6MegO2bf0lUXZsSGbH9YAxfUGLQF/CD5vsrsoi1hZPtvEwqL/5WJFg/dXC5f8yJ6K+RBTl6lB7vkghErBVlUGN68JdMZyN/X9ImFVYijGpL5fnQ==',key_name='tempest-keypair-1683511725',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-lh3y6fnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=e7614440-9110-4515-b0bc-4309000d37be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "address": "fa:16:3e:64:8d:02", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2e0154-f2", "ovs_interfaceid": "5c2e0154-f2e2-4836-a0a5-b2999c43fc01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG os_vif [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2e0154-f2, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=704b23d9-7e6f-4901-a0ab-2dabe301cbbd) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:38:38 user nova-compute[74788]: INFO os_vif [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:8d:02,bridge_name='br-int',has_traffic_filtering=True,id=5c2e0154-f2e2-4836-a0a5-b2999c43fc01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2e0154-f2')
Nov 08 15:38:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Deleting instance files /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be_del
Nov 08 15:38:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Deletion of /opt/stack/data/nova/instances/e7614440-9110-4515-b0bc-4309000d37be_del complete
Nov 08 15:38:38 user nova-compute[74788]: INFO nova.compute.manager [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: e7614440-9110-4515-b0bc-4309000d37be] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 15:38:38 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:38:38 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:39 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: e7614440-9110-4515-b0bc-4309000d37be] Took 0.77 seconds to deallocate network for instance.
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:39 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Deleted allocations for instance e7614440-9110-4515-b0bc-4309000d37be
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2a235937-9969-4004-8904-2245e7405f84 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "e7614440-9110-4515-b0bc-4309000d37be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:39 user nova-compute[74788]: INFO nova.compute.manager [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Terminating instance
Nov 08 15:38:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-ab4c5727-0c23-49d5-8100-387b6b5eb5d7 req-bc8a6973-6e79-4f4f-8b2a-087d188687fb service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-unplugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] Acquiring lock "e7614440-9110-4515-b0bc-4309000d37be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] Lock "e7614440-9110-4515-b0bc-4309000d37be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] No waiting events found dispatching network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:40 user nova-compute[74788]: WARNING nova.compute.manager [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received unexpected event network-vif-plugged-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 for instance with vm_state deleted and task_state None.
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.compute.manager [req-322776eb-4a47-4647-9a0a-bc72bdd01fab req-0890f2fd-951d-433a-99ea-709680cf9240 service nova] [instance: e7614440-9110-4515-b0bc-4309000d37be] Received event network-vif-deleted-5c2e0154-f2e2-4836-a0a5-b2999c43fc01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Instance destroyed successfully.
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'resources' on Instance uuid c8c68545-480e-469e-88eb-44a996062ca6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-23126705',display_name='tempest-ServerActionsTestOtherA-server-23126705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-23126705',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:34:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-rxc5nqrn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=c8c68545-480e-469e-88eb-44a996062ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "8a40c838-2845-4846-a1b9-c39fc25d8044", "address": "fa:16:3e:84:2e:d9", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a40c838-28", "ovs_interfaceid": "8a40c838-2845-4846-a1b9-c39fc25d8044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_vif [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a40c838-28, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f89eccb-54cf-4436-9092-f7055f52ef60) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:38:40 user nova-compute[74788]: INFO os_vif [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:2e:d9,bridge_name='br-int',has_traffic_filtering=True,id=8a40c838-2845-4846-a1b9-c39fc25d8044,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a40c838-28')
Nov 08 15:38:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbyPXZSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:38:40 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c62083-e69c-45e1-9139-e060684c0fc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:38:40 user nova-compute[74788]: No targets found.
Nov 08 15:38:40 user nova-compute[74788]: iSNS:
Nov 08 15:38:40 user nova-compute[74788]: No targets found.
Nov 08 15:38:40 user nova-compute[74788]: STATIC:
Nov 08 15:38:40 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e
Nov 08 15:38:40 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:38:40 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:38:40 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15
Nov 08 15:38:40 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:38:40 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:38:40 user nova-compute[74788]: FIRMWARE:
Nov 08 15:38:40 user nova-compute[74788]: No targets found.
Nov 08 15:38:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:38:40 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:38:40 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdab6e9-1fe9-429f-93bd-aef1178b004a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e88bd-bf67-44b8-a9e3-98b62748551c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:38:40 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:38:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e (non-flash)
Nov 08 15:38:40 user nova-compute[74788]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:38:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f775846ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a55937-0351-47cd-a57c-68970407e9d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9673d894-a180-45e8-81ff-3eba029e45bb]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8662458-2957-467a-b572-5277c8cd7409]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0000ee-b9c1-43ab-ad72-adb68a37a6df]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c733414-1892-4672-a8d0-fa9dfb9861fa]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ea96c-f36c-46d5-b1ef-5e52a550034b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260]
Nov 08 15:38:41 user nova-compute[74788]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e, portal: 172.16.0.220,3260] successful.
Nov 08 15:38:41 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734aae35-4d1a-45a5-bf01-1d5198410a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3ace04-cd79-490c-82d5-2b7771359f63]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] <== disconnect_volume: return (297ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:38:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Deleting instance files /opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6_del
Nov 08 15:38:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Deletion of /opt/stack/data/nova/instances/c8c68545-480e-469e-88eb-44a996062ca6_del complete
Nov 08 15:38:41 user nova-compute[74788]: INFO nova.compute.manager [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 15:38:41 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:38:41 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:38:42 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:42 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Took 1.01 seconds to deallocate network for instance.
Nov 08 15:38:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] Acquiring lock "c8c68545-480e-469e-88eb-44a996062ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] Lock "c8c68545-480e-469e-88eb-44a996062ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] No waiting events found dispatching network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:38:42 user nova-compute[74788]: WARNING nova.compute.manager [req-b598816c-7f6d-4c83-9108-e6817e037107 req-2fa35804-3287-41c7-b356-41c2a523f9b1 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received unexpected event network-vif-plugged-8a40c838-2845-4846-a1b9-c39fc25d8044 for instance with vm_state active and task_state deleting.
Nov 08 15:38:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-dfeb25b6-7cbf-45b4-9a49-9023fa750880 req-7d289694-fd4f-4f60-8543-ea209d8390c0 service nova] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Received event network-vif-deleted-8a40c838-2845-4846-a1b9-c39fc25d8044 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:38:43 user nova-compute[74788]: INFO nova.compute.manager [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Took 0.91 seconds to detach 1 volumes for instance.
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: c8c68545-480e-469e-88eb-44a996062ca6] Deleting volume: 734aae35-4d1a-45a5-bf01-1d5198410a4e {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.volume.cinder [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Update attachment failed for attachment ef9a9c11-62f6-4a7a-b2c8-3d21963776ec. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a)
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Traceback (most recent call last):
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     driver_block_device.attach_block_devices(
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     _log_and_attach(device)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     self._do_attach(context, instance, volume, volume_api,
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     self._volume_attach(context, volume, connector, instance,
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     connection_info = volume_api.attachment_update(
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     res = method(self, ctx, *args, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     with excutils.save_and_reraise_exception():
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     self.force_reraise()
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     raise self.value
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     return method.func(obj, *args, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     resp = self._update('/attachments/%s' % id, body)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     return self.request(url, method, **kwargs)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9]     raise exceptions.from_response(resp, body)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a)
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] 
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.claims [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Aborting claim: <nova.compute.claims.Claim object at 0x7f777c439f00> {{(pid=74788) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.011s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:43 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Deleted allocations for instance c8c68545-480e-469e-88eb-44a996062ca6
Nov 08 15:38:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b73dd61a-a7ea-4469-a86b-d1979608c576 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "c8c68545-480e-469e-88eb-44a996062ca6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.621s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.221s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Build of instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a) {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.utils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Build of instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74788) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 15:38:43 user nova-compute[74788]: ERROR nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Build of instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a): nova.exception.BuildAbortException: Build of instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a)
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Unplugging VIFs for instance {{(pid=74788) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-468977935',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-468977935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-468977935',id=38,image_ref='e851335b-29b4-4eca-8942-98256f89c9f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy72VTYtC/Ug0aSgcz0sarypFyZe5WsRCzgT0kvaotDDVdzQTq8CHltHhBjvO+1ykZZ0vlGIPQtg32QiaKdOcTd9AJ1PYmG+5Nf+dk50QCkLlS8fdzGVnnRhhFIh904fg==',key_name='tempest-keypair-1873491545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-xw2pooq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1548248568',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9655d103734d485691fe3d82e4e68032',uuid=e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "address": "fa:16:3e:7f:bd:10", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc935a953-fb", "ovs_interfaceid": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "address": "fa:16:3e:7f:bd:10", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc935a953-fb", "ovs_interfaceid": "c935a953-fb5e-42b4-bb8b-366f39cbea50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bd:10,bridge_name='br-int',has_traffic_filtering=True,id=c935a953-fb5e-42b4-bb8b-366f39cbea50,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc935a953-fb') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG os_vif [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bd:10,bridge_name='br-int',has_traffic_filtering=True,id=c935a953-fb5e-42b4-bb8b-366f39cbea50,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc935a953-fb') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc935a953-fb, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:38:43 user nova-compute[74788]: INFO os_vif [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:bd:10,bridge_name='br-int',has_traffic_filtering=True,id=c935a953-fb5e-42b4-bb8b-366f39cbea50,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc935a953-fb')
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Unplugged VIFs for instance {{(pid=74788) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:38:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:38:44 user nova-compute[74788]: DEBUG nova.network.neutron [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:44 user nova-compute[74788]: INFO nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Took 0.42 seconds to deallocate network for instance.
Nov 08 15:38:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Detaching volume: 6e0bdca4-319a-474e-8811-ed20bf779f71 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 15:38:44 user nova-compute[74788]: INFO nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Detaching volume 6e0bdca4-319a-474e-8811-ed20bf779f71
Nov 08 15:38:44 user nova-compute[74788]: ERROR nova.virt.block_device [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Unable to call for a driver detach of volume 6e0bdca4-319a-474e-8811-ed20bf779f71 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f5eed010-acd5-4bd4-a7a3-080f82c7d53a)
Nov 08 15:38:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9] Deleting volume: 6e0bdca4-319a-474e-8811-ed20bf779f71 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:38:44 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9
Nov 08 15:38:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-eda9a38d-6e36-4785-8c2a-59ccd5bf5e40 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "e2c7db1a-49aa-4c65-9c2b-38f3e539f2e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.043s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:48 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating instance_info_cache with network_info: [{"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-c54aa85a-14a7-4971-8037-59f89dec0b3e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:38:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:38:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:38:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:38:54 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:38:55 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:38:55 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.37793731689453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance c54aa85a-14a7-4971-8037-59f89dec0b3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:38:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:38:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:38:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:38:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:38:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:39:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:27 user nova-compute[74788]: INFO nova.compute.manager [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Terminating instance
Nov 08 15:39:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-unplugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] No waiting events found dispatching network-vif-unplugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-334051da-c682-4ad8-b5ae-25d625bb29f6 req-77da1958-db85-4045-a186-6404892398f8 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-unplugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:39:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Instance destroyed successfully.
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'resources' on Instance uuid c54aa85a-14a7-4971-8037-59f89dec0b3e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1983285058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1983285058',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaU+TCCH0OLDCPZsVpuSVAXLwV9w99PuTiODCBxoNZsnT/AA9hxI3ThK31aIeWAkHfyjgKZK2DFgPv+weH52rwJmoZAKIuE4ieEvnsW1TSukjGuPR/pL/1//IXgRiDE4Q==',key_name='tempest-keypair-1159745895',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-rm3lgwv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9655d103734d485691fe3d82e4e68032',uuid=c54aa85a-14a7-4971-8037-59f89dec0b3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "address": "fa:16:3e:11:4a:7d", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25dfc3a-1d", "ovs_interfaceid": "c25dfc3a-1d0e-40ef-956c-2aa6e77941f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_vif [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc25dfc3a-1d, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3a9dcfa-6c42-4570-bd51-03e0af454502) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:28 user nova-compute[74788]: INFO os_vif [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:4a:7d,bridge_name='br-int',has_traffic_filtering=True,id=c25dfc3a-1d0e-40ef-956c-2aa6e77941f4,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc25dfc3a-1d')
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pokBafeA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:39:28 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24381d4-32b9-483c-ac8c-a5bcb2083909]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:39:28 user nova-compute[74788]: No targets found.
Nov 08 15:39:28 user nova-compute[74788]: iSNS:
Nov 08 15:39:28 user nova-compute[74788]: No targets found.
Nov 08 15:39:28 user nova-compute[74788]: STATIC:
Nov 08 15:39:28 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15
Nov 08 15:39:28 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:39:28 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:39:28 user nova-compute[74788]: FIRMWARE:
Nov 08 15:39:28 user nova-compute[74788]: No targets found.
Nov 08 15:39:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:39:28 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:39:28 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f49a43e-0e08-420c-9ca4-dc904576a7cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9bdf59-346a-471c-b3dd-f772e406e1b0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:39:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 (non-flash)
Nov 08 15:39:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f775846ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e396f969-1e17-4af5-a3fb-ec073253fcf1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3ed95-3fd9-415c-9c47-298f67fa9152]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9086684-0f75-4f95-828d-08a61e27b354]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb904f2-8497-4593-addd-8c397c747f1d]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3d3fa89d-0b287b6273ca3c52', '/dev/disk/by-id/scsi-23062323837623632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3d3fa89d') {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1cbda7-97e8-407c-af7d-620d180a3be5]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[086190ac-eb9a-4534-b726-d8d9fd5b8a6c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00da0e-ee2b-471d-b3f3-011ca04c607e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260]
Nov 08 15:39:28 user nova-compute[74788]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15, portal: 172.16.0.220,3260] successful.
Nov 08 15:39:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d83198e6-295a-44a8-85ff-5c4446ff8c15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab79d655-66b0-40ab-95a3-b6c22d5a9040]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== disconnect_volume: return (310ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:39:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Deleting instance files /opt/stack/data/nova/instances/c54aa85a-14a7-4971-8037-59f89dec0b3e_del
Nov 08 15:39:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Deletion of /opt/stack/data/nova/instances/c54aa85a-14a7-4971-8037-59f89dec0b3e_del complete
Nov 08 15:39:28 user nova-compute[74788]: INFO nova.compute.manager [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 15:39:28 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:39:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:39:29 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Took 0.82 seconds to deallocate network for instance.
Nov 08 15:39:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-60680743-0450-4d57-8ecc-7be4e90ef4f1 req-d60dcedc-902a-4180-a6e3-1dd7398d8292 service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-deleted-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] Acquiring lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] No waiting events found dispatching network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:29 user nova-compute[74788]: WARNING nova.compute.manager [req-53e56f7d-769a-4550-a682-80485fe76d2a req-09a2c290-1d1e-4cc0-81b1-80c95e926cdb service nova] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Received unexpected event network-vif-plugged-c25dfc3a-1d0e-40ef-956c-2aa6e77941f4 for instance with vm_state active and task_state deleting.
Nov 08 15:39:30 user nova-compute[74788]: INFO nova.compute.manager [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Took 1.00 seconds to detach 1 volumes for instance.
Nov 08 15:39:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: c54aa85a-14a7-4971-8037-59f89dec0b3e] Deleting volume: d83198e6-295a-44a8-85ff-5c4446ff8c15 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:39:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:30 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:39:30 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:39:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:30 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance c54aa85a-14a7-4971-8037-59f89dec0b3e
Nov 08 15:39:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b169a1f7-3a49-4dae-b08c-7d2540d139d4 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "c54aa85a-14a7-4971-8037-59f89dec0b3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.416s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:31 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:39:31 user nova-compute[74788]: INFO nova.compute.claims [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Claim successful on node user
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:39:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.policy [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e567adf9bfe49e58cc73195084c7acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e545713667df40d8b632db43b4f991b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:39:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Creating image(s)
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk 1073741824" returned: 0 in 0.055s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.247s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Successfully created port: dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Cannot resize image /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Ensure instance console log exists: /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Successfully updated port: dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-changed-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Refreshing instance network info cache due to event network-changed-dec5e807-3c28-4631-88be-9b67cedf2760. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:39:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Instance network_info: |[{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Refreshing network info cache for port dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Start _get_guest_xml network_info=[{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:39:34 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:39:34 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885537243',display_name='tempest-AttachVolumeNegativeTest-server-1885537243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885537243',id=39,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7hG/DYcsQx26oSb+to3zIyDEr7GJZ+j1oU+idhXMLoHmEaMO2N1oPBvNRCIzkPe1hSSPM857Lsjjex1rS2iFQGp+L+1pzC+Z6DG9rYtg1wuIxVSauRPqXe7pWMA3f/Bw==',key_name='tempest-keypair-529896048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-75bvp2cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=4a97a8bd-7317-496b-9c1f-8d2a1e7e102d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:39:34 user nova-compute[74788]:   <uuid>4a97a8bd-7317-496b-9c1f-8d2a1e7e102d</uuid>
Nov 08 15:39:34 user nova-compute[74788]:   <name>instance-00000027</name>
Nov 08 15:39:34 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:39:34 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:39:34 user nova-compute[74788]:   <metadata>
Nov 08 15:39:34 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:39:34 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1885537243</nova:name>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:39:34</nova:creationTime>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:39:34 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:39:34 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:owner>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:user uuid="2e567adf9bfe49e58cc73195084c7acf">tempest-AttachVolumeNegativeTest-1449712443-project-member</nova:user>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:project uuid="e545713667df40d8b632db43b4f991b4">tempest-AttachVolumeNegativeTest-1449712443</nova:project>
Nov 08 15:39:34 user nova-compute[74788]:       </nova:owner>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:39:34 user nova-compute[74788]:       <nova:ports>
Nov 08 15:39:34 user nova-compute[74788]:         <nova:port uuid="dec5e807-3c28-4631-88be-9b67cedf2760">
Nov 08 15:39:34 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 15:39:34 user nova-compute[74788]:         </nova:port>
Nov 08 15:39:34 user nova-compute[74788]:       </nova:ports>
Nov 08 15:39:34 user nova-compute[74788]:     </nova:instance>
Nov 08 15:39:34 user nova-compute[74788]:   </metadata>
Nov 08 15:39:34 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:39:34 user nova-compute[74788]:     <system>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="serial">4a97a8bd-7317-496b-9c1f-8d2a1e7e102d</entry>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="uuid">4a97a8bd-7317-496b-9c1f-8d2a1e7e102d</entry>
Nov 08 15:39:34 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:39:34 user nova-compute[74788]:     </system>
Nov 08 15:39:34 user nova-compute[74788]:   </sysinfo>
Nov 08 15:39:34 user nova-compute[74788]:   <os>
Nov 08 15:39:34 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:39:34 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:39:34 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:39:34 user nova-compute[74788]:   </os>
Nov 08 15:39:34 user nova-compute[74788]:   <features>
Nov 08 15:39:34 user nova-compute[74788]:     <acpi/>
Nov 08 15:39:34 user nova-compute[74788]:     <apic/>
Nov 08 15:39:34 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:39:34 user nova-compute[74788]:   </features>
Nov 08 15:39:34 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:39:34 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:39:34 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:39:34 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:39:34 user nova-compute[74788]:   </clock>
Nov 08 15:39:34 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:39:34 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:39:34 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:39:34 user nova-compute[74788]:   </cpu>
Nov 08 15:39:34 user nova-compute[74788]:   <devices>
Nov 08 15:39:34 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:39:34 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:39:34 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk"/>
Nov 08 15:39:34 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:39:34 user nova-compute[74788]:     </disk>
Nov 08 15:39:34 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:39:34 user nova-compute[74788]:       <mac address="fa:16:3e:65:65:2f"/>
Nov 08 15:39:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:39:34 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:39:34 user nova-compute[74788]:       <target dev="tapdec5e807-3c"/>
Nov 08 15:39:34 user nova-compute[74788]:     </interface>
Nov 08 15:39:34 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:39:34 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/console.log" append="off"/>
Nov 08 15:39:34 user nova-compute[74788]:     </serial>
Nov 08 15:39:34 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:39:34 user nova-compute[74788]:     <video>
Nov 08 15:39:34 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:39:34 user nova-compute[74788]:     </video>
Nov 08 15:39:34 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:39:34 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:39:34 user nova-compute[74788]:     </rng>
Nov 08 15:39:34 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:39:34 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:39:34 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:39:34 user nova-compute[74788]:     </memballoon>
Nov 08 15:39:34 user nova-compute[74788]:   </devices>
Nov 08 15:39:34 user nova-compute[74788]: </domain>
Nov 08 15:39:34 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885537243',display_name='tempest-AttachVolumeNegativeTest-server-1885537243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885537243',id=39,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7hG/DYcsQx26oSb+to3zIyDEr7GJZ+j1oU+idhXMLoHmEaMO2N1oPBvNRCIzkPe1hSSPM857Lsjjex1rS2iFQGp+L+1pzC+Z6DG9rYtg1wuIxVSauRPqXe7pWMA3f/Bw==',key_name='tempest-keypair-529896048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-75bvp2cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=4a97a8bd-7317-496b-9c1f-8d2a1e7e102d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG os_vif [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03bf9544-9c7c-54bc-8206-7e6cc93317df', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec5e807-3c, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdec5e807-3c, col_values=(('qos', UUID('9806908e-8448-434b-8057-d2f92130ee37')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdec5e807-3c, col_values=(('external_ids', {'iface-id': 'dec5e807-3c28-4631-88be-9b67cedf2760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:65:2f', 'vm-uuid': '4a97a8bd-7317-496b-9c1f-8d2a1e7e102d'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:34 user nova-compute[74788]: INFO os_vif [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c')
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:65:65:2f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updated VIF entry in instance network info cache for port dec5e807-3c28-4631-88be-9b67cedf2760. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG nova.network.neutron [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:39:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2f163f85-5136-41c5-948b-c640ec695073 req-7530e978-7457-4cc7-a7ae-62a5bf484c0d service nova] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:39:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] No waiting events found dispatching network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:36 user nova-compute[74788]: WARNING nova.compute.manager [req-8925ff27-fe61-480c-bc7e-4709a81bf821 req-b98fac0c-1edf-4c31-b25d-cae597d38180 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received unexpected event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 for instance with vm_state building and task_state spawning.
Nov 08 15:39:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] No waiting events found dispatching network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:38 user nova-compute[74788]: WARNING nova.compute.manager [req-aea035a1-c59e-44b4-aa52-1aaa6049f74b req-e6f059d3-2418-4d6f-a2b4-bbbf211a5843 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received unexpected event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 for instance with vm_state building and task_state spawning.
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:39:38 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Instance spawned successfully.
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:39:38 user nova-compute[74788]: INFO nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 08 15:39:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:39:38 user nova-compute[74788]: INFO nova.compute.manager [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Took 6.48 seconds to build instance.
Nov 08 15:39:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c680a77c-5121-4b1c-9e28-61a75f881ed9 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.584s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:43 user nova-compute[74788]: INFO nova.compute.manager [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Terminating instance
Nov 08 15:39:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-unplugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] No waiting events found dispatching network-vif-unplugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-49001cab-0438-4e0b-8434-63edd5554df1 req-6c2dab85-dcf1-45e5-84ed-4e3212b15094 service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-unplugged-384c3842-8fb5-435d-8451-91efba79f9b8 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Instance destroyed successfully.
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lazy-loading 'resources' on Instance uuid e0c3ad12-7047-4836-9f7b-c80a95aeeac6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-808333465',display_name='tempest-ServerActionsTestOtherA-server-808333465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-808333465',id=15,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfALUPevtXmVy+zlzR0B530mHbcLqSDikWHfHb/s/w+TeXGS937AwEQ2yR//LXZ0hMRzv+hZ/Mc9kZhVi+p6+gSMrAS+TLvbHlsgcN/aLH4PaB18JQzUsQ4F2QUs5YjAQ==',key_name='tempest-keypair-980083106',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c097c366f91c496e9f5a4cfaff0e14c6',ramdisk_id='',reservation_id='r-ah2d0bp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-27641552',owner_user_name='tempest-ServerActionsTestOtherA-27641552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30bfaf63a8bf4172b0a72ee8536a76b2',uuid=e0c3ad12-7047-4836-9f7b-c80a95aeeac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converting VIF {"id": "384c3842-8fb5-435d-8451-91efba79f9b8", "address": "fa:16:3e:dc:95:ea", "network": {"id": "94568cf2-2709-4a7f-9e9f-d617c1efff1f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-334563219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c097c366f91c496e9f5a4cfaff0e14c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384c3842-8f", "ovs_interfaceid": "384c3842-8fb5-435d-8451-91efba79f9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG os_vif [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap384c3842-8f, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f8725c-0d49-4a05-a066-a70e7ee74054) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:39:44 user nova-compute[74788]: INFO os_vif [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:95:ea,bridge_name='br-int',has_traffic_filtering=True,id=384c3842-8fb5-435d-8451-91efba79f9b8,network=Network(94568cf2-2709-4a7f-9e9f-d617c1efff1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384c3842-8f')
Nov 08 15:39:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Deleting instance files /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6_del
Nov 08 15:39:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Deletion of /opt/stack/data/nova/instances/e0c3ad12-7047-4836-9f7b-c80a95aeeac6_del complete
Nov 08 15:39:44 user nova-compute[74788]: INFO nova.compute.manager [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 15:39:44 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:39:44 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Took 0.50 seconds to deallocate network for instance.
Nov 08 15:39:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:45 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Deleted allocations for instance e0c3ad12-7047-4836-9f7b-c80a95aeeac6
Nov 08 15:39:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3727727e-1ac6-4f05-b246-e5c2c5d43a35 tempest-ServerActionsTestOtherA-27641552 tempest-ServerActionsTestOtherA-27641552-project-member] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] Acquiring lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] Lock "e0c3ad12-7047-4836-9f7b-c80a95aeeac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] No waiting events found dispatching network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:39:45 user nova-compute[74788]: WARNING nova.compute.manager [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received unexpected event network-vif-plugged-384c3842-8fb5-435d-8451-91efba79f9b8 for instance with vm_state deleted and task_state None.
Nov 08 15:39:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-b16e4e5b-53db-429e-aacf-718bc31928f2 req-d726e7ea-c950-46c0-8a47-4061e01b9e6b service nova] [instance: e0c3ad12-7047-4836-9f7b-c80a95aeeac6] Received event network-vif-deleted-384c3842-8fb5-435d-8451-91efba79f9b8 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:39:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:39:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:39:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:54 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:55 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:39:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:39:56 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=25.367149353027344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:39:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:39:57 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:39:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:39:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:39:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:40:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:11 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:40:40 user nova-compute[74788]: INFO nova.compute.claims [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Claim successful on node user
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:40:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:40:40 user nova-compute[74788]: INFO nova.virt.block_device [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Booting with volume 00a80a43-2323-40d5-9612-d557ee1fff8e at /dev/vda
Nov 08 15:40:40 user nova-compute[74788]: DEBUG nova.policy [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG os_brick.utils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d20f0b4-fb76-47ea-8b9c-90d7adf86e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:40:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeaadbc-1e02-4f66-bbff-0ee7d653c091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3d568-5370-43f4-acd6-2288025ca6ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc59d9-a3cd-4f7e-af17-79e64d4cde56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:40:41 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:40:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9465e49-1a2c-44d6-bcd2-45e912b47254]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG os_brick.utils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updating existing volume attachment record: d34cb45b-fda9-48e1-a029-d588d6ce66eb {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:40:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Successfully created port: 34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Successfully updated port: 34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-changed-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Refreshing instance network info cache due to event network-changed-34f6d5cd-904c-497a-99d1-e4621c0f5075. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] Acquiring lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.network.neutron [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updating instance_info_cache with network_info: [{"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Instance network_info: |[{"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] Acquired lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:43 user nova-compute[74788]: DEBUG nova.network.neutron [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Refreshing network info cache for port 34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:40:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:40:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updated VIF entry in instance network info cache for port 34f6d5cd-904c-497a-99d1-e4621c0f5075. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:40:44 user nova-compute[74788]: DEBUG nova.network.neutron [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updating instance_info_cache with network_info: [{"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f43cd479-a424-40e4-9a9d-523e8a07721e req-8d3ace78-d02f-40ed-9098-3d2fd07921e1 service nova] Releasing lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:40:48 user nova-compute[74788]: INFO nova.compute.claims [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Claim successful on node user
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:40:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:40:49 user nova-compute[74788]: INFO nova.compute.claims [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Claim successful on node user
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.policy [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fe699714bde4a5f9a726d0d43695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b242b447c4d4e49abf8d4df70317aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:40:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Creating image(s)
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "/opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "/opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.266s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk 1073741824" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.policy [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8015e2645eac4fefb444c80dd1922ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6442811e582464cb1edd2a82d930bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Successfully created port: 5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:40:49 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Creating image(s)
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "/opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.233s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:40:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Cannot resize image /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Ensure instance console log exists: /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Successfully created port: 2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk 1073741824" returned: 0 in 0.049s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Successfully updated port: 5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-changed-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Refreshing instance network info cache due to event network-changed-5b26b1ed-f7be-40ed-8572-ffb933ee61b5. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] Acquiring lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] Acquired lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Refreshing network info cache for port 5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Cannot resize image /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Ensure instance console log exists: /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fa0ec0d0-abd3-4d08-b4ad-a7797b1d2c2c req-9dcee27d-b531-4ae0-a06d-665bc293693f service nova] Releasing lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquired lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Successfully updated port: 2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-changed-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Refreshing instance network info cache due to event network-changed-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [{"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Releasing lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance network_info: |[{"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Start _get_guest_xml network_info=[{"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:40:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-207086023',display_name='tempest-VolumesSnapshotTestJSON-instance-207086023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-207086023',id=41,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfdwdnY8xI5luSf30Bg62hJhIRnQb7vL53DCpccCtBM4Jy1t00IIQAxo1VOHFkAtWc6rOCt1iwIRGouw8E1rUcdzNib9Q5qULnItKcILprsRw1Oj5OEwFa9W7bgLTlZAg==',key_name='tempest-keypair-1355616051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-gwrx4wkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=b6077b7d-a6eb-43e3-889f-2eb61708119e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'pci_devices' on Instance uuid b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:40:51 user nova-compute[74788]:   <uuid>b6077b7d-a6eb-43e3-889f-2eb61708119e</uuid>
Nov 08 15:40:51 user nova-compute[74788]:   <name>instance-00000029</name>
Nov 08 15:40:51 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:40:51 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:40:51 user nova-compute[74788]:   <metadata>
Nov 08 15:40:51 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:40:51 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-207086023</nova:name>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:40:51</nova:creationTime>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:40:51 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:owner>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:user uuid="5fe699714bde4a5f9a726d0d43695be2">tempest-VolumesSnapshotTestJSON-1290769345-project-member</nova:user>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:project uuid="2b242b447c4d4e49abf8d4df70317aad">tempest-VolumesSnapshotTestJSON-1290769345</nova:project>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:owner>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:ports>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:port uuid="5b26b1ed-f7be-40ed-8572-ffb933ee61b5">
Nov 08 15:40:51 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 15:40:51 user nova-compute[74788]:         </nova:port>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:ports>
Nov 08 15:40:51 user nova-compute[74788]:     </nova:instance>
Nov 08 15:40:51 user nova-compute[74788]:   </metadata>
Nov 08 15:40:51 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:40:51 user nova-compute[74788]:     <system>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="serial">b6077b7d-a6eb-43e3-889f-2eb61708119e</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="uuid">b6077b7d-a6eb-43e3-889f-2eb61708119e</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:40:51 user nova-compute[74788]:     </system>
Nov 08 15:40:51 user nova-compute[74788]:   </sysinfo>
Nov 08 15:40:51 user nova-compute[74788]:   <os>
Nov 08 15:40:51 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:40:51 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:40:51 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:40:51 user nova-compute[74788]:   </os>
Nov 08 15:40:51 user nova-compute[74788]:   <features>
Nov 08 15:40:51 user nova-compute[74788]:     <acpi/>
Nov 08 15:40:51 user nova-compute[74788]:     <apic/>
Nov 08 15:40:51 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:40:51 user nova-compute[74788]:   </features>
Nov 08 15:40:51 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:40:51 user nova-compute[74788]:   </clock>
Nov 08 15:40:51 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:40:51 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:40:51 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:40:51 user nova-compute[74788]:   </cpu>
Nov 08 15:40:51 user nova-compute[74788]:   <devices>
Nov 08 15:40:51 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:40:51 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:40:51 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk"/>
Nov 08 15:40:51 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:     </disk>
Nov 08 15:40:51 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:40:51 user nova-compute[74788]:       <mac address="fa:16:3e:e9:37:19"/>
Nov 08 15:40:51 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:40:51 user nova-compute[74788]:       <target dev="tap5b26b1ed-f7"/>
Nov 08 15:40:51 user nova-compute[74788]:     </interface>
Nov 08 15:40:51 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:40:51 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/console.log" append="off"/>
Nov 08 15:40:51 user nova-compute[74788]:     </serial>
Nov 08 15:40:51 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:40:51 user nova-compute[74788]:     <video>
Nov 08 15:40:51 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:     </video>
Nov 08 15:40:51 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:40:51 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:40:51 user nova-compute[74788]:     </rng>
Nov 08 15:40:51 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:40:51 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:40:51 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:40:51 user nova-compute[74788]:     </memballoon>
Nov 08 15:40:51 user nova-compute[74788]:   </devices>
Nov 08 15:40:51 user nova-compute[74788]: </domain>
Nov 08 15:40:51 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-207086023',display_name='tempest-VolumesSnapshotTestJSON-instance-207086023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-207086023',id=41,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfdwdnY8xI5luSf30Bg62hJhIRnQb7vL53DCpccCtBM4Jy1t00IIQAxo1VOHFkAtWc6rOCt1iwIRGouw8E1rUcdzNib9Q5qULnItKcILprsRw1Oj5OEwFa9W7bgLTlZAg==',key_name='tempest-keypair-1355616051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-gwrx4wkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=b6077b7d-a6eb-43e3-889f-2eb61708119e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG os_vif [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be7856b-cdc1-5eb0-a4cb-e10094d9039a', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b26b1ed-f7, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b26b1ed-f7, col_values=(('qos', UUID('64148bc9-9555-47d4-a27c-77c699d0b820')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b26b1ed-f7, col_values=(('external_ids', {'iface-id': '5b26b1ed-f7be-40ed-8572-ffb933ee61b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:37:19', 'vm-uuid': 'b6077b7d-a6eb-43e3-889f-2eb61708119e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: INFO os_vif [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7')
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Instance network_info: |[{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Refreshing network info cache for port 2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Start _get_guest_xml network_info=[{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:40:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:51 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-189805868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-189805868',id=42,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-0t5uqfb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:50Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=149d3800-34cd-479c-9f6c-626743b00fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.objects.instance [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:40:51 user nova-compute[74788]:   <uuid>149d3800-34cd-479c-9f6c-626743b00fbe</uuid>
Nov 08 15:40:51 user nova-compute[74788]:   <name>instance-0000002a</name>
Nov 08 15:40:51 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:40:51 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:40:51 user nova-compute[74788]:   <metadata>
Nov 08 15:40:51 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:40:51 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-189805868</nova:name>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:40:51</nova:creationTime>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:40:51 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:owner>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:owner>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:40:51 user nova-compute[74788]:       <nova:ports>
Nov 08 15:40:51 user nova-compute[74788]:         <nova:port uuid="2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda">
Nov 08 15:40:51 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:40:51 user nova-compute[74788]:         </nova:port>
Nov 08 15:40:51 user nova-compute[74788]:       </nova:ports>
Nov 08 15:40:51 user nova-compute[74788]:     </nova:instance>
Nov 08 15:40:51 user nova-compute[74788]:   </metadata>
Nov 08 15:40:51 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:40:51 user nova-compute[74788]:     <system>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="serial">149d3800-34cd-479c-9f6c-626743b00fbe</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="uuid">149d3800-34cd-479c-9f6c-626743b00fbe</entry>
Nov 08 15:40:51 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:40:51 user nova-compute[74788]:     </system>
Nov 08 15:40:51 user nova-compute[74788]:   </sysinfo>
Nov 08 15:40:51 user nova-compute[74788]:   <os>
Nov 08 15:40:51 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:40:51 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:40:51 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:40:51 user nova-compute[74788]:   </os>
Nov 08 15:40:51 user nova-compute[74788]:   <features>
Nov 08 15:40:51 user nova-compute[74788]:     <acpi/>
Nov 08 15:40:51 user nova-compute[74788]:     <apic/>
Nov 08 15:40:51 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:40:51 user nova-compute[74788]:   </features>
Nov 08 15:40:51 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:40:51 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:40:51 user nova-compute[74788]:   </clock>
Nov 08 15:40:51 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:40:51 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:40:51 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:40:51 user nova-compute[74788]:   </cpu>
Nov 08 15:40:51 user nova-compute[74788]:   <devices>
Nov 08 15:40:51 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:40:51 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:40:51 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk"/>
Nov 08 15:40:51 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:     </disk>
Nov 08 15:40:51 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:40:51 user nova-compute[74788]:       <mac address="fa:16:3e:76:26:bc"/>
Nov 08 15:40:51 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:40:51 user nova-compute[74788]:       <target dev="tap2cf2ae3f-bc"/>
Nov 08 15:40:51 user nova-compute[74788]:     </interface>
Nov 08 15:40:51 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:40:51 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/console.log" append="off"/>
Nov 08 15:40:51 user nova-compute[74788]:     </serial>
Nov 08 15:40:51 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:40:51 user nova-compute[74788]:     <video>
Nov 08 15:40:51 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:40:51 user nova-compute[74788]:     </video>
Nov 08 15:40:51 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:40:51 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:40:51 user nova-compute[74788]:     </rng>
Nov 08 15:40:51 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:40:51 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:40:51 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:40:51 user nova-compute[74788]:     </memballoon>
Nov 08 15:40:51 user nova-compute[74788]:   </devices>
Nov 08 15:40:51 user nova-compute[74788]: </domain>
Nov 08 15:40:51 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-189805868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-189805868',id=42,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-0t5uqfb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:50Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=149d3800-34cd-479c-9f6c-626743b00fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG os_vif [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db204904-327a-5889-b5fd-917c3a449ca2', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No VIF found with MAC fa:16:3e:e9:37:19, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf2ae3f-bc, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cf2ae3f-bc, col_values=(('qos', UUID('7b58c7c9-3a63-4aa7-858d-5fd4fd09f8a6')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cf2ae3f-bc, col_values=(('external_ids', {'iface-id': '2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:26:bc', 'vm-uuid': '149d3800-34cd-479c-9f6c-626743b00fbe'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:51 user nova-compute[74788]: INFO os_vif [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc')
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:76:26:bc, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated VIF entry in instance network info cache for port 2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8f25ddf6-5d07-45ab-8b86-f2c91d83f725 req-86fcb9c3-c4f7-47ba-95df-99f901f1fd2c service nova] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Skipping network cache update for instance because it is Building. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Skipping network cache update for instance because it is Building. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 15:40:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Skipping network cache update for instance because it is Building. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] No waiting events found dispatching network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:40:54 user nova-compute[74788]: WARNING nova.compute.manager [req-86360595-f728-4d86-b7bf-0cc7d4d3a4f9 req-41586d7c-df70-4aa1-b353-5da5055b7c6a service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received unexpected event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda for instance with vm_state building and task_state spawning.
Nov 08 15:40:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.compute.manager [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:40:54 user nova-compute[74788]: WARNING nova.compute.manager [req-b7fc68e0-4502-4823-83f2-7a5b7a2d9620 req-c55614c0-f861-45e2-a97f-9a63e9645a13 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state building and task_state spawning.
Nov 08 15:40:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:40:54 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:40:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] No waiting events found dispatching network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:40:56 user nova-compute[74788]: WARNING nova.compute.manager [req-614b43b4-a2a1-4325-8744-7110abd846df req-8fb0838e-1510-4070-aaf3-ffebdb9298cd service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received unexpected event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda for instance with vm_state building and task_state spawning.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:40:56 user nova-compute[74788]: WARNING nova.compute.manager [req-65afd52c-848c-482c-96ae-12894884b347 req-8e53af35-ac42-485d-93a2-80b4c98c05fb service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state building and task_state spawning.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:40:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Instance spawned successfully.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:40:56 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance spawned successfully.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:40:56 user nova-compute[74788]: INFO nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Took 7.76 seconds to spawn the instance on the hypervisor.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:40:56 user nova-compute[74788]: INFO nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Took 7.10 seconds to spawn the instance on the hypervisor.
Nov 08 15:40:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:40:57 user nova-compute[74788]: INFO nova.compute.manager [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Took 8.10 seconds to build instance.
Nov 08 15:40:57 user nova-compute[74788]: INFO nova.compute.manager [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Took 8.54 seconds to build instance.
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-13406e02-ad99-4163-8443-c26b4bc8002f tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.201s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d09d80d5-d7fb-4532-bb37-e5ee1ef956c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.685s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:57 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:40:58 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:58 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:40:58 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.350841522216797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:40:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 494826f3-e2ee-476f-b4bf-2b920bb960f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b6077b7d-a6eb-43e3-889f-2eb61708119e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:40:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:41:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Creating image(s)
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Ensure instance console log exists: /opt/stack/data/nova/instances/494826f3-e2ee-476f-b4bf-2b920bb960f6/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Start _get_guest_xml network_info=[{"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '494826f3-e2ee-476f-b4bf-2b920bb960f6', 'attached_at': '', 'detached_at': '', 'volume_id': '00a80a43-2323-40d5-9612-d557ee1fff8e', 'serial': '00a80a43-2323-40d5-9612-d557ee1fff8e'}, 'attachment_id': 'd34cb45b-fda9-48e1-a029-d588d6ce66eb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:41:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:41:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:41:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:41:04 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:41:04 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fabee6-a84e-472b-b0ae-011516166478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:41:04 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca4db30-546c-4b16-8814-ba621a35cbb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e] added
Nov 08 15:41:04 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163e5ad-a5cb-43f7-9030-dd09afc044d6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7509ad-cfd7-4489-9d44-2bccad0d0dee]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHNgfYpU {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHNgfYpU" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[605d4466-b871-4775-9e9a-44fb604216c0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHNgfYpU'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[36efc74b-aa67-460e-af66-64fdca0811be]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b7e60-8322-463c-b757-5c7caf47ea5a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:41:05 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:41:05 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:41:05 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:41:05 user nova-compute[74788]: 
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[239b25f2-49a5-46eb-979d-5f3c6ba44de1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]
Nov 08 15:41:05 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.
Nov 08 15:41:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b730b4d-41ed-400b-9581-bf24f6fc31a6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9888882-f81c-4074-b6e9-570d43944feb]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a3559-6d6e-4042-a693-a2918e6a0746]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26565346563633838', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565346563633838', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1885138597',display_name='tempest-TestVolumeBootPattern-server-1885138597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1885138597',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-68vihpan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:41Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=494826f3-e2ee-476f-b4bf-2b920bb960f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.objects.instance [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'pci_devices' on Instance uuid 494826f3-e2ee-476f-b4bf-2b920bb960f6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:41:06 user nova-compute[74788]:   <uuid>494826f3-e2ee-476f-b4bf-2b920bb960f6</uuid>
Nov 08 15:41:06 user nova-compute[74788]:   <name>instance-00000028</name>
Nov 08 15:41:06 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:41:06 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:41:06 user nova-compute[74788]:   <metadata>
Nov 08 15:41:06 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:41:06 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:41:06 user nova-compute[74788]:       <nova:name>tempest-TestVolumeBootPattern-server-1885138597</nova:name>
Nov 08 15:41:06 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:41:04</nova:creationTime>
Nov 08 15:41:06 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:41:06 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:41:06 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:41:06 user nova-compute[74788]:       <nova:owner>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:user uuid="9655d103734d485691fe3d82e4e68032">tempest-TestVolumeBootPattern-1548248568-project-member</nova:user>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:project uuid="ef632441d171499280801b367697b620">tempest-TestVolumeBootPattern-1548248568</nova:project>
Nov 08 15:41:06 user nova-compute[74788]:       </nova:owner>
Nov 08 15:41:06 user nova-compute[74788]:       <nova:ports>
Nov 08 15:41:06 user nova-compute[74788]:         <nova:port uuid="34f6d5cd-904c-497a-99d1-e4621c0f5075">
Nov 08 15:41:06 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:41:06 user nova-compute[74788]:         </nova:port>
Nov 08 15:41:06 user nova-compute[74788]:       </nova:ports>
Nov 08 15:41:06 user nova-compute[74788]:     </nova:instance>
Nov 08 15:41:06 user nova-compute[74788]:   </metadata>
Nov 08 15:41:06 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:41:06 user nova-compute[74788]:     <system>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="serial">494826f3-e2ee-476f-b4bf-2b920bb960f6</entry>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="uuid">494826f3-e2ee-476f-b4bf-2b920bb960f6</entry>
Nov 08 15:41:06 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:41:06 user nova-compute[74788]:     </system>
Nov 08 15:41:06 user nova-compute[74788]:   </sysinfo>
Nov 08 15:41:06 user nova-compute[74788]:   <os>
Nov 08 15:41:06 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:41:06 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:41:06 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:41:06 user nova-compute[74788]:   </os>
Nov 08 15:41:06 user nova-compute[74788]:   <features>
Nov 08 15:41:06 user nova-compute[74788]:     <acpi/>
Nov 08 15:41:06 user nova-compute[74788]:     <apic/>
Nov 08 15:41:06 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:41:06 user nova-compute[74788]:   </features>
Nov 08 15:41:06 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:41:06 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:41:06 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:41:06 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:41:06 user nova-compute[74788]:   </clock>
Nov 08 15:41:06 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:41:06 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:41:06 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:41:06 user nova-compute[74788]:   </cpu>
Nov 08 15:41:06 user nova-compute[74788]:   <devices>
Nov 08 15:41:06 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:41:06 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:41:06 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:41:06 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:41:06 user nova-compute[74788]:       <serial>00a80a43-2323-40d5-9612-d557ee1fff8e</serial>
Nov 08 15:41:06 user nova-compute[74788]:     </disk>
Nov 08 15:41:06 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:41:06 user nova-compute[74788]:       <mac address="fa:16:3e:ea:e0:8b"/>
Nov 08 15:41:06 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:41:06 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:41:06 user nova-compute[74788]:       <target dev="tap34f6d5cd-90"/>
Nov 08 15:41:06 user nova-compute[74788]:     </interface>
Nov 08 15:41:06 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:41:06 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/494826f3-e2ee-476f-b4bf-2b920bb960f6/console.log" append="off"/>
Nov 08 15:41:06 user nova-compute[74788]:     </serial>
Nov 08 15:41:06 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:41:06 user nova-compute[74788]:     <video>
Nov 08 15:41:06 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:41:06 user nova-compute[74788]:     </video>
Nov 08 15:41:06 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:41:06 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:41:06 user nova-compute[74788]:     </rng>
Nov 08 15:41:06 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:41:06 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:41:06 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:41:06 user nova-compute[74788]:     </memballoon>
Nov 08 15:41:06 user nova-compute[74788]:   </devices>
Nov 08 15:41:06 user nova-compute[74788]: </domain>
Nov 08 15:41:06 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1885138597',display_name='tempest-TestVolumeBootPattern-server-1885138597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1885138597',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-68vihpan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:40:41Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=494826f3-e2ee-476f-b4bf-2b920bb960f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG os_vif [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcc3cc1d-7ddf-596f-a23e-5d57434f23c1', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34f6d5cd-90, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34f6d5cd-90, col_values=(('qos', UUID('9195931a-4165-4f44-83bd-29d0851b07a5')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34f6d5cd-90, col_values=(('external_ids', {'iface-id': '34f6d5cd-904c-497a-99d1-e4621c0f5075', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e0:8b', 'vm-uuid': '494826f3-e2ee-476f-b4bf-2b920bb960f6'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:06 user nova-compute[74788]: INFO os_vif [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90')
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:41:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No VIF found with MAC fa:16:3e:ea:e0:8b, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:41:07 user nova-compute[74788]: WARNING nova.compute.manager [req-2c7041ee-db1e-4c49-8b39-690f003e55c4 req-77dcf926-82a5-46d8-9cb9-be93f846fec2 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state building and task_state spawning.
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:41:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Instance spawned successfully.
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:41:09 user nova-compute[74788]: INFO nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 08 15:41:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:41:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:41:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:10 user nova-compute[74788]: DEBUG nova.compute.manager [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:41:10 user nova-compute[74788]: WARNING nova.compute.manager [req-9c4bc3aa-4dd0-4936-9613-09050e26260c req-95cb55d1-14f6-4b3a-970d-b8ec169840fa service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state building and task_state spawning.
Nov 08 15:41:10 user nova-compute[74788]: INFO nova.compute.manager [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Took 29.76 seconds to build instance.
Nov 08 15:41:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-2c40616b-1d0a-4931-98b1-b3a37619fa5c tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.893s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-changed-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:41:22 user nova-compute[74788]: DEBUG nova.compute.manager [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Refreshing instance network info cache due to event network-changed-dec5e807-3c28-4631-88be-9b67cedf2760. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:41:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:41:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:41:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Refreshing network info cache for port dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:41:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updated VIF entry in instance network info cache for port dec5e807-3c28-4631-88be-9b67cedf2760. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:41:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:41:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3137b734-78cb-48f2-88a7-bc3720a3b9b2 req-92071135-d829-4f84-9b41-c7b3ffb9f5e4 service nova] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:41:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG nova.objects.instance [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:29 user nova-compute[74788]: INFO nova.compute.manager [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Attaching volume 9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 to /dev/vdb
Nov 08 15:41:29 user nova-compute[74788]: DEBUG os_brick.utils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da4035-ebb2-4585-adac-69323f2c925d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e8df3e-c904-4619-9fdd-99a6c7d4396c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed84dee6-83ca-4d98-a9b7-f343b276fb0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b8b46-ecaa-4a59-85b1-f4c3b000ef12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:29 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:41:30 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:41:30 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb20d08c-c5b2-46d8-86d9-91db3588423d]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG os_brick.utils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:41:30 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating existing volume attachment record: 59b986b0-e745-4ba8-80fd-65ffd9afe92f {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:41:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:41:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctWDqhaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:41:52 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:41:52 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:41:52 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4165e0-6c74-466c-9b3a-0e58d2371e43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:41:52 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e745fc-f2ab-49d7-8a73-9b1c391d6e8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0] added
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9dd81d-4916-4b43-8bc1-e8932c246d5e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c4390-12ca-48a2-beda-7e387dd46cc1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctWDqhaR {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctWDqhaR" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a28c3-07bf-4674-8cba-dc5eecc5e156]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctWDqhaR'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c7bfd-6b20-4003-9c06-f15c6b0fa235]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e4db2-b88a-4eda-9876-dbd26bfdb85f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f50296-8531-446c-961e-ded18bc5f5ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260]
Nov 08 15:41:52 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260] successful.
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c56a5c-d02a-4a64-8a43-bb22dd37d982]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1875a1-a521-49aa-8235-79e031cdc211]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:52 user nova-compute[74788]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:41:52 user nova-compute[74788]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)
Nov 08 15:41:52 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62299dad-8c23-4dee-a466-176a12046968]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:41:52 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctWDqhaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23863306138626331', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863306138626331', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.objects.instance [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:41:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:41:53 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:41:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:41:53 user nova-compute[74788]:   <serial>9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0</serial>
Nov 08 15:41:53 user nova-compute[74788]: </disk>
Nov 08 15:41:53 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:41:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:65:65:2f, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:41:54 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-86b27aa4-6a51-4c7a-80d3-9e7cbf035205 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.500s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:55 user nova-compute[74788]: INFO nova.compute.manager [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Detaching volume 9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0
Nov 08 15:41:55 user nova-compute[74788]: INFO nova.virt.block_device [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Attempting to driver detach volume 9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 from mountpoint /dev/vdb
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Attempting to detach device vdb from instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:41:55 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:41:55 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:41:55 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:41:55 user nova-compute[74788]:   <serial>9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0</serial>
Nov 08 15:41:55 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:41:55 user nova-compute[74788]: </disk>
Nov 08 15:41:55 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:41:55 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d from the persistent domain config.
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:41:55 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:41:55 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:41:55 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:41:55 user nova-compute[74788]:   <serial>9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0</serial>
Nov 08 15:41:55 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:41:55 user nova-compute[74788]: </disk>
Nov 08 15:41:55 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:41:55 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:41:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:41:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [{"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:41:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:41:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:41:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:57 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:41:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:41:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:41:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:41:58 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:41:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:42:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:42:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.292503356933594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 494826f3-e2ee-476f-b4bf-2b920bb960f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b6077b7d-a6eb-43e3-889f-2eb61708119e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:42:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:42:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:11 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:15 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d is timed out.
Nov 08 15:42:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d from the live domain config.
Nov 08 15:42:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctWDqhaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:42:15 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca8780e-3699-46da-befd-720e8b137b16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:42:15 user nova-compute[74788]: No targets found.
Nov 08 15:42:15 user nova-compute[74788]: iSNS:
Nov 08 15:42:15 user nova-compute[74788]: No targets found.
Nov 08 15:42:15 user nova-compute[74788]: STATIC:
Nov 08 15:42:15 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0
Nov 08 15:42:15 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:42:15 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:42:15 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:42:15 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:42:15 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:42:15 user nova-compute[74788]: FIRMWARE:
Nov 08 15:42:15 user nova-compute[74788]: No targets found.
Nov 08 15:42:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:42:15 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:42:15 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6cffac-e8ff-4387-8e41-153e955d1e94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[76292105-d4ff-4992-abad-64497f1d5fd2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:42:15 user nova-compute[74788]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)
Nov 08 15:42:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:42:15 user nova-compute[74788]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 (non-flash)
Nov 08 15:42:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f775836e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e943198-37de-4a67-8ae0-a2823045ea50]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af74b0-37d7-4689-8118-a264046d78b1]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b77fb81-6d43-46cd-af5e-909bedfff760]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351502e-c60e-448d-9701-97647cc04b08]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869ed47-6850-4a42-837d-f0c073035cdf]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9226a045-2f07-4e88-8423-6abce5ce25fa]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260]
Nov 08 15:42:15 user nova-compute[74788]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0, portal: 172.16.0.220,3260] successful.
Nov 08 15:42:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf4212d-99a8-41fb-ba87-3b8c3e08b3d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0bda6-6a5b-4f41-a5cd-e18ae83bcbca]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== disconnect_volume: return (263ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:42:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:42:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:16 user nova-compute[74788]: DEBUG nova.objects.instance [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:42:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-62fd31e3-c6f4-4ada-9f38-8cc83bc5b7e2 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-changed-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Refreshing instance network info cache due to event network-changed-34f6d5cd-904c-497a-99d1-e4621c0f5075. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] Acquiring lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] Acquired lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.network.neutron [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Refreshing network info cache for port 34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.network.neutron [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updated VIF entry in instance network info cache for port 34f6d5cd-904c-497a-99d1-e4621c0f5075. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.network.neutron [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updating instance_info_cache with network_info: [{"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a105ad5b-8ce9-4440-9b06-813969cc50e8 req-2cf27a52-5c8a-48ec-9ebd-3b84fe129e5c service nova] Releasing lock "refresh_cache-494826f3-e2ee-476f-b4bf-2b920bb960f6" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:32 user nova-compute[74788]: INFO nova.compute.manager [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Terminating instance
Nov 08 15:42:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-973337b5-192e-4fef-9f05-4c3c15d9617f req-8a8f03e6-a294-47f9-9ef4-2906fb281252 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Instance destroyed successfully.
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'resources' on Instance uuid 494826f3-e2ee-476f-b4bf-2b920bb960f6 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1885138597',display_name='tempest-TestVolumeBootPattern-server-1885138597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1885138597',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-68vihpan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:41:10Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=494826f3-e2ee-476f-b4bf-2b920bb960f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "address": "fa:16:3e:ea:e0:8b", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34f6d5cd-90", "ovs_interfaceid": "34f6d5cd-904c-497a-99d1-e4621c0f5075", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_vif [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34f6d5cd-90, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9195931a-4165-4f44-83bd-29d0851b07a5) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:33 user nova-compute[74788]: INFO os_vif [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e0:8b,bridge_name='br-int',has_traffic_filtering=True,id=34f6d5cd-904c-497a-99d1-e4621c0f5075,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34f6d5cd-90')
Nov 08 15:42:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:42:33 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac089c-9d4e-4d92-b7b5-6bb4bcb00e1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:42:33 user nova-compute[74788]: No targets found.
Nov 08 15:42:33 user nova-compute[74788]: iSNS:
Nov 08 15:42:33 user nova-compute[74788]: No targets found.
Nov 08 15:42:33 user nova-compute[74788]: STATIC:
Nov 08 15:42:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:42:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:42:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:42:33 user nova-compute[74788]: FIRMWARE:
Nov 08 15:42:33 user nova-compute[74788]: No targets found.
Nov 08 15:42:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:42:33 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:42:33 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec31272-6a68-4fc6-89b9-b76c10042f5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f0e8b9-6dc0-46ec-847d-165dee7f9d10]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:42:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:42:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501ee54-4a50-44eb-8163-d0447a602bf9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c2796-4927-4b9c-b442-b25f90d37d5d]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37bc019-c703-4cc7-88b2-27751b32d5b0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dffa5f0-d603-4c0b-be9c-21728d68fa75]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_23278a79',) {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94b9ac-6945-4db3-a6ff-9b39f01cdeb9]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca1fbd1-4dfe-40b4-88cf-3bcde1b4a9b8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fadc0c-3147-4394-bd96-e0faf838d5b5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]
Nov 08 15:42:33 user nova-compute[74788]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.
Nov 08 15:42:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c17e5-484d-430c-8bb7-1c56f8c3e818]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== disconnect_volume: return (339ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:42:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Deleting instance files /opt/stack/data/nova/instances/494826f3-e2ee-476f-b4bf-2b920bb960f6_del
Nov 08 15:42:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Deletion of /opt/stack/data/nova/instances/494826f3-e2ee-476f-b4bf-2b920bb960f6_del complete
Nov 08 15:42:34 user nova-compute[74788]: INFO nova.compute.manager [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 15:42:34 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:35 user nova-compute[74788]: WARNING nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state active and task_state deleting.
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:35 user nova-compute[74788]: WARNING nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state active and task_state deleting.
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:35 user nova-compute[74788]: WARNING nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state active and task_state deleting.
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-unplugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Acquiring lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] No waiting events found dispatching network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:35 user nova-compute[74788]: WARNING nova.compute.manager [req-9a682ba0-f5b4-42d6-becb-3f2eecf6497a req-df3895da-26bc-4383-b1b1-4ba64c62d897 service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received unexpected event network-vif-plugged-34f6d5cd-904c-497a-99d1-e4621c0f5075 for instance with vm_state active and task_state deleting.
Nov 08 15:42:35 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:35 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Took 1.28 seconds to deallocate network for instance.
Nov 08 15:42:37 user nova-compute[74788]: DEBUG nova.compute.manager [req-490214e4-0672-4a47-92c2-9164ea317e1c req-eadd7e65-7380-4ada-af9f-d2d8e783bd9c service nova] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Received event network-vif-deleted-34f6d5cd-904c-497a-99d1-e4621c0f5075 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-changed-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Refreshing instance network info cache due to event network-changed-5b26b1ed-f7be-40ed-8572-ffb933ee61b5. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] Acquiring lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] Acquired lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Refreshing network info cache for port 5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:42:39 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Ignoring supplied device name: /dev/vdb
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:39 user nova-compute[74788]: INFO nova.compute.manager [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Attaching volume faf762e2-9aad-4df8-b7f3-988abe6033e5 to /dev/vdb
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updated VIF entry in instance network info cache for port 5b26b1ed-f7be-40ed-8572-ffb933ee61b5. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [{"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-225093ca-3063-4068-9768-330b79894b63 req-12ece919-42ae-4127-a6f3-e72dda34e511 service nova] Releasing lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG os_brick.utils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:42:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1974345e-b6cb-448b-bda2-7ae66a476207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab09de0-d449-4c2b-b316-076797a4fc82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: INFO nova.compute.manager [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] instance snapshotting
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f41b5-fbd7-4fa1-aa33-625277d44775]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d47a070-a030-42ae-ac49-20842b83f055]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:42:40 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0318fdfa-82cb-4a0d-ba8e-534cd2a2c02a]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG os_brick.utils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating existing volume attachment record: e7765414-0305-4598-ac5e-2f34ca4e8abc {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:42:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Beginning live snapshot process
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db.delta 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db.delta 1073741824" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 15:42:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:42:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:42:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 15:42:42 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:42:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db.delta /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db.delta /opt/stack/data/nova/instances/snapshots/tmppidy8f24/d39bd32201c84e96bda107ae192d57db" returned: 0 in 0.509s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:42 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Snapshot extracted, beginning image upload
Nov 08 15:42:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:45 user nova-compute[74788]: INFO nova.compute.manager [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Terminating instance
Nov 08 15:42:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-unplugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] No waiting events found dispatching network-vif-unplugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9f3b9d2-3ae8-4a7b-88d1-7f976ec7701a req-e4e96350-77e5-453a-883e-c67d9857356f service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-unplugged-dec5e807-3c28-4631-88be-9b67cedf2760 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Snapshot image upload complete
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.compute.manager [None req-32b85d1f-f59a-4cb3-b77f-9e784b6c4704 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Took 6.03 seconds to snapshot the instance on the hypervisor.
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Instance destroyed successfully.
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'resources' on Instance uuid 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1885537243',display_name='tempest-AttachVolumeNegativeTest-server-1885537243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1885537243',id=39,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7hG/DYcsQx26oSb+to3zIyDEr7GJZ+j1oU+idhXMLoHmEaMO2N1oPBvNRCIzkPe1hSSPM857Lsjjex1rS2iFQGp+L+1pzC+Z6DG9rYtg1wuIxVSauRPqXe7pWMA3f/Bw==',key_name='tempest-keypair-529896048',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-75bvp2cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=4a97a8bd-7317-496b-9c1f-8d2a1e7e102d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "dec5e807-3c28-4631-88be-9b67cedf2760", "address": "fa:16:3e:65:65:2f", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec5e807-3c", "ovs_interfaceid": "dec5e807-3c28-4631-88be-9b67cedf2760", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG os_vif [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec5e807-3c, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9806908e-8448-434b-8057-d2f92130ee37) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:46 user nova-compute[74788]: INFO os_vif [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:65:2f,bridge_name='br-int',has_traffic_filtering=True,id=dec5e807-3c28-4631-88be-9b67cedf2760,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec5e807-3c')
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Deleting instance files /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d_del
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Deletion of /opt/stack/data/nova/instances/4a97a8bd-7317-496b-9c1f-8d2a1e7e102d_del complete
Nov 08 15:42:46 user nova-compute[74788]: INFO nova.compute.manager [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 08 15:42:46 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:42:46 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:47 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Took 0.82 seconds to deallocate network for instance.
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-5f6a1c1d-cf7b-4156-baf7-ab0e86394c23 req-5ffb3fb1-09ef-40df-85a4-91b5c8de83d9 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-deleted-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:47 user nova-compute[74788]: INFO nova.compute.manager [req-5f6a1c1d-cf7b-4156-baf7-ab0e86394c23 req-5ffb3fb1-09ef-40df-85a4-91b5c8de83d9 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Neutron deleted interface dec5e807-3c28-4631-88be-9b67cedf2760; detaching it from the instance and deleting it from the info cache
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.network.neutron [req-5f6a1c1d-cf7b-4156-baf7-ab0e86394c23 req-5ffb3fb1-09ef-40df-85a4-91b5c8de83d9 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-5f6a1c1d-cf7b-4156-baf7-ab0e86394c23 req-5ffb3fb1-09ef-40df-85a4-91b5c8de83d9 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Detach interface failed, port_id=dec5e807-3c28-4631-88be-9b67cedf2760, reason: Instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:47 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Deleted allocations for instance 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4ca0428f-bf71-4fa1-84cb-1f6c40b32fb7 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] Acquiring lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] Lock "4a97a8bd-7317-496b-9c1f-8d2a1e7e102d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] No waiting events found dispatching network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:42:47 user nova-compute[74788]: WARNING nova.compute.manager [req-34f5e4a3-8ab4-4462-911e-bee85b00b70a req-a3efa5db-4445-492c-8eb7-e777d1827f60 service nova] [instance: 4a97a8bd-7317-496b-9c1f-8d2a1e7e102d] Received unexpected event network-vif-plugged-dec5e807-3c28-4631-88be-9b67cedf2760 for instance with vm_state deleted and task_state None.
Nov 08 15:42:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:50 user nova-compute[74788]: INFO nova.compute.manager [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 494826f3-e2ee-476f-b4bf-2b920bb960f6] Took 15.33 seconds to detach 1 volumes for instance.
Nov 08 15:42:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:50 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:42:50 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:42:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:50 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance 494826f3-e2ee-476f-b4bf-2b920bb960f6
Nov 08 15:42:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c2900684-ff54-4139-bae7-5014a92a1ad2 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "494826f3-e2ee-476f-b4bf-2b920bb960f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.197s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:42:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:55 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [{"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-b6077b7d-a6eb-43e3-889f-2eb61708119e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:42:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:42:58 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:42:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:43:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.2696533203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b6077b7d-a6eb-43e3-889f-2eb61708119e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:43:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvLwigoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:43:02 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:43:02 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:43:02 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce06913c-c77a-462b-8ab0-cc52f1cdb6c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:43:02 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9ef0c-34a1-4ce2-a5e8-fa7ac45faf34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5] added
Nov 08 15:43:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b299ed-efc3-4093-a063-977968ea9b1f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3af016-b0da-45a2-bc79-cbdd4100cee5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvLwigoP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvLwigoP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab3ab5-8a83-435f-b61b-2026f7a5413d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvLwigoP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc11fc-2181-4496-b7fa-b068bc146f2b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8492d974-2f7b-4493-a175-0e2e2ccf1169]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:43:02 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 15:43:02 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:43:02 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 15:43:02 user nova-compute[74788]: 
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a64ef3-ef86-451e-aa25-af52650f9e29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260]
Nov 08 15:43:02 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260] successful.
Nov 08 15:43:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eede8bc-ba34-4ca0-a34e-8e2e7fcaff1d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00e674c-40cb-4c98-ad84-9608a46fee3b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:43:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:43:02 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a508cef-a191-4d0c-9188-b61b13ed254e]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:43:02 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvLwigoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26637623037643532', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637623037643532', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:43:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:43:03 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:43:03 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:43:03 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:43:03 user nova-compute[74788]:   <serial>faf762e2-9aad-4df8-b7f3-988abe6033e5</serial>
Nov 08 15:43:03 user nova-compute[74788]: </disk>
Nov 08 15:43:03 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No VIF found with MAC fa:16:3e:e9:37:19, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9db1cbf9-eb8f-4019-87a1-ec35513033fb tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.405s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:43:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:43:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:43:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:11 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:43:24 user nova-compute[74788]: INFO nova.compute.claims [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Claim successful on node user
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:43:24 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:43:24 user nova-compute[74788]: DEBUG nova.policy [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:43:25 user nova-compute[74788]: INFO nova.virt.block_device [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Booting with volume 00a80a43-2323-40d5-9612-d557ee1fff8e at /dev/vda
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.utils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0cd053-ec65-4b12-8faf-a30d3f9f4c68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6269c95-3ee7-461a-9429-02f015560772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[59967772-7fb6-45b0-8cba-1143c13544a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455a2cc-b6d9-40e6-9de3-db23950d082a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:43:25 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:43:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2477a0-e258-44cc-b20d-4f11bec9bb43]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG os_brick.utils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating existing volume attachment record: 00037d5b-be4e-4bdd-adae-c1e73a39457b {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:43:25 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Successfully created port: 59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Successfully updated port: 59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing instance network info cache due to event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] Acquiring lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Instance network_info: |[{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] Acquired lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:43:27 user nova-compute[74788]: DEBUG nova.network.neutron [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updated VIF entry in instance network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:43:27 user nova-compute[74788]: DEBUG nova.network.neutron [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7e8b70cb-3462-417c-9b97-b9052dbabf0a req-5a03ef57-1c8a-4156-ae8b-595928fb3221 service nova] Releasing lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:43:39 user nova-compute[74788]: INFO nova.compute.claims [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Claim successful on node user
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:43:39 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.policy [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e567adf9bfe49e58cc73195084c7acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e545713667df40d8b632db43b4f991b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:43:39 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Creating image(s)
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "/opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk 1073741824" returned: 0 in 0.107s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Successfully created port: a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Cannot resize image /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Successfully updated port: a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquired lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-changed-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Refreshing instance network info cache due to event network-changed-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] Acquiring lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Releasing lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Instance network_info: |[{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] Acquired lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Refreshing network info cache for port a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Start _get_guest_xml network_info=[{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:43:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:43:41 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1242529938',display_name='tempest-AttachVolumeNegativeTest-server-1242529938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1242529938',id=44,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrSFYdNVwXIltls//Mzo3h96HmljEBPRVOu0ZhFX0FlkAhs9jzBkAVZF1qWNCnNUM7/92miNtTdD/rHuFAjAFjC5lJtVH3t9CqF6w4enKB93IhDZIvim06pwD/baVBWkw==',key_name='tempest-keypair-248219110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-r76qa5ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=3a2d396e-1663-41c0-8437-3d8ed419d3de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:43:41 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:43:42 user nova-compute[74788]:   <uuid>3a2d396e-1663-41c0-8437-3d8ed419d3de</uuid>
Nov 08 15:43:42 user nova-compute[74788]:   <name>instance-0000002c</name>
Nov 08 15:43:42 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:43:42 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:43:42 user nova-compute[74788]:   <metadata>
Nov 08 15:43:42 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:43:42 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1242529938</nova:name>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:43:41</nova:creationTime>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:43:42 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:43:42 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:owner>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:user uuid="2e567adf9bfe49e58cc73195084c7acf">tempest-AttachVolumeNegativeTest-1449712443-project-member</nova:user>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:project uuid="e545713667df40d8b632db43b4f991b4">tempest-AttachVolumeNegativeTest-1449712443</nova:project>
Nov 08 15:43:42 user nova-compute[74788]:       </nova:owner>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:43:42 user nova-compute[74788]:       <nova:ports>
Nov 08 15:43:42 user nova-compute[74788]:         <nova:port uuid="a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01">
Nov 08 15:43:42 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:43:42 user nova-compute[74788]:         </nova:port>
Nov 08 15:43:42 user nova-compute[74788]:       </nova:ports>
Nov 08 15:43:42 user nova-compute[74788]:     </nova:instance>
Nov 08 15:43:42 user nova-compute[74788]:   </metadata>
Nov 08 15:43:42 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:43:42 user nova-compute[74788]:     <system>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="serial">3a2d396e-1663-41c0-8437-3d8ed419d3de</entry>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="uuid">3a2d396e-1663-41c0-8437-3d8ed419d3de</entry>
Nov 08 15:43:42 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:43:42 user nova-compute[74788]:     </system>
Nov 08 15:43:42 user nova-compute[74788]:   </sysinfo>
Nov 08 15:43:42 user nova-compute[74788]:   <os>
Nov 08 15:43:42 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:43:42 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:43:42 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:43:42 user nova-compute[74788]:   </os>
Nov 08 15:43:42 user nova-compute[74788]:   <features>
Nov 08 15:43:42 user nova-compute[74788]:     <acpi/>
Nov 08 15:43:42 user nova-compute[74788]:     <apic/>
Nov 08 15:43:42 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:43:42 user nova-compute[74788]:   </features>
Nov 08 15:43:42 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:43:42 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:43:42 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:43:42 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:43:42 user nova-compute[74788]:   </clock>
Nov 08 15:43:42 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:43:42 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:43:42 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:43:42 user nova-compute[74788]:   </cpu>
Nov 08 15:43:42 user nova-compute[74788]:   <devices>
Nov 08 15:43:42 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:43:42 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:43:42 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk"/>
Nov 08 15:43:42 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:43:42 user nova-compute[74788]:     </disk>
Nov 08 15:43:42 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:43:42 user nova-compute[74788]:       <mac address="fa:16:3e:f5:b2:e4"/>
Nov 08 15:43:42 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:43:42 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:43:42 user nova-compute[74788]:       <target dev="tapa1c7cb69-c9"/>
Nov 08 15:43:42 user nova-compute[74788]:     </interface>
Nov 08 15:43:42 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:43:42 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/console.log" append="off"/>
Nov 08 15:43:42 user nova-compute[74788]:     </serial>
Nov 08 15:43:42 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:43:42 user nova-compute[74788]:     <video>
Nov 08 15:43:42 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:43:42 user nova-compute[74788]:     </video>
Nov 08 15:43:42 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:43:42 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:43:42 user nova-compute[74788]:     </rng>
Nov 08 15:43:42 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:43:42 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:43:42 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:43:42 user nova-compute[74788]:     </memballoon>
Nov 08 15:43:42 user nova-compute[74788]:   </devices>
Nov 08 15:43:42 user nova-compute[74788]: </domain>
Nov 08 15:43:42 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1242529938',display_name='tempest-AttachVolumeNegativeTest-server-1242529938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1242529938',id=44,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrSFYdNVwXIltls//Mzo3h96HmljEBPRVOu0ZhFX0FlkAhs9jzBkAVZF1qWNCnNUM7/92miNtTdD/rHuFAjAFjC5lJtVH3t9CqF6w4enKB93IhDZIvim06pwD/baVBWkw==',key_name='tempest-keypair-248219110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-r76qa5ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=3a2d396e-1663-41c0-8437-3d8ed419d3de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG os_vif [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b330184-bcf3-5af2-a46d-7bc769f535fb', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1c7cb69-c9, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1c7cb69-c9, col_values=(('qos', UUID('5bcd1ad2-3ccc-4ccf-aca2-e99fcd52431f')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1c7cb69-c9, col_values=(('external_ids', {'iface-id': 'a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b2:e4', 'vm-uuid': '3a2d396e-1663-41c0-8437-3d8ed419d3de'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:42 user nova-compute[74788]: INFO os_vif [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9')
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:f5:b2:e4, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updated VIF entry in instance network info cache for port a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG nova.network.neutron [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e50d63c0-8f8d-476b-98dd-6eef9243bc02 req-312ff648-1a00-4e6c-9fb9-8310a1b6d090 service nova] Releasing lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:43:43 user nova-compute[74788]: WARNING nova.compute.manager [req-105db5ee-b840-4e27-83fb-2e81be507e6e req-c5f2a39e-75da-4136-a35e-79fe5b4a531d service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state building and task_state spawning.
Nov 08 15:43:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:43:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Instance spawned successfully.
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:43:45 user nova-compute[74788]: INFO nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:43:45 user nova-compute[74788]: WARNING nova.compute.manager [req-9ef81fb2-17e5-4045-a132-b5a701f899ed req-e89ba28c-eca7-4122-b6e7-d645ec6de606 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state building and task_state spawning.
Nov 08 15:43:45 user nova-compute[74788]: INFO nova.compute.manager [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Took 6.32 seconds to build instance.
Nov 08 15:43:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a63e1a25-1813-4589-ac0c-a49095139cdd tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.425s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:47 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:43:47 user nova-compute[74788]: INFO nova.compute.claims [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Claim successful on node user
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:43:48 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:43:48 user nova-compute[74788]: INFO nova.virt.block_device [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Booting with blank volume at /dev/vda
Nov 08 15:43:48 user nova-compute[74788]: DEBUG nova.policy [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8015e2645eac4fefb444c80dd1922ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6442811e582464cb1edd2a82d930bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:43:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:49 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Successfully created port: 19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Successfully updated port: 19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-changed-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Refreshing instance network info cache due to event network-changed-19755a1e-b211-471d-b8ba-42d4e663ca6a. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.network.neutron [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance network_info: |[{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Refreshing network info cache for port 19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:43:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updated VIF entry in instance network info cache for port 19755a1e-b211-471d-b8ba-42d4e663ca6a. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:43:51 user nova-compute[74788]: DEBUG nova.network.neutron [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c0c8a710-2b28-45dc-86c1-6cdadc5d3b0e req-e5d27a02-39e5-42fc-b1e0-5ca5e191704d service nova] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:43:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:43:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:43:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:43:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:43:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:43:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:43:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:43:58 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.utils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15652c1-e154-4387-a90a-bcc494cc2e4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1764bf-deca-44b8-8543-bf572996dc7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc0fcc-bebe-44fb-b5f7-32c0b60fa532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05e7e5-3b7b-4c27-89b6-dec3dd937fd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:43:59 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f54ab-c315-4165-aca2-7c2a2219184a]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG os_brick.utils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating existing volume attachment record: bfdceda5-e26a-43ca-ae83-d05cce79f372 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:43:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:00 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.251140594482422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance b6077b7d-a6eb-43e3-889f-2eb61708119e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3a2d396e-1663-41c0-8437-3d8ed419d3de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:44:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:44:01 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:44:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:44:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:44:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:11 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:14 user nova-compute[74788]: INFO nova.compute.manager [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Detaching volume faf762e2-9aad-4df8-b7f3-988abe6033e5
Nov 08 15:44:14 user nova-compute[74788]: INFO nova.virt.block_device [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Attempting to driver detach volume faf762e2-9aad-4df8-b7f3-988abe6033e5 from mountpoint /dev/vdb
Nov 08 15:44:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Attempting to detach device vdb from instance b6077b7d-a6eb-43e3-889f-2eb61708119e from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:44:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:44:14 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:44:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:44:14 user nova-compute[74788]:   <serial>faf762e2-9aad-4df8-b7f3-988abe6033e5</serial>
Nov 08 15:44:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:44:14 user nova-compute[74788]: </disk>
Nov 08 15:44:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:44:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully detached device vdb from instance b6077b7d-a6eb-43e3-889f-2eb61708119e from the persistent domain config.
Nov 08 15:44:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6077b7d-a6eb-43e3-889f-2eb61708119e from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:44:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:44:14 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:44:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:44:14 user nova-compute[74788]:   <serial>faf762e2-9aad-4df8-b7f3-988abe6033e5</serial>
Nov 08 15:44:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:44:14 user nova-compute[74788]: </disk>
Nov 08 15:44:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:44:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:44:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Creating image(s)
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Ensure instance console log exists: /opt/stack/data/nova/instances/7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Start _get_guest_xml network_info=[{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e', 'attached_at': '', 'detached_at': '', 'volume_id': '00a80a43-2323-40d5-9612-d557ee1fff8e', 'serial': '00a80a43-2323-40d5-9612-d557ee1fff8e'}, 'attachment_id': '00037d5b-be4e-4bdd-adae-c1e73a39457b', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:44:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Creating image(s)
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Ensure instance console log exists: /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start _get_guest_xml network_info=[{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ebeaebbb-acd5-4f72-9b11-d81d85eca41f', 'attached_at': '', 'detached_at': '', 'volume_id': '469c5642-1a5b-4433-8cc7-5eb379463959', 'serial': '469c5642-1a5b-4433-8cc7-5eb379463959'}, 'attachment_id': 'bfdceda5-e26a-43ca-ae83-d05cce79f372', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:44:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:44:22 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:22 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:22 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:44:22 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d6625-5842-4c02-8e2a-b713910c9882]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:44:22 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c97e58-8013-4cba-a659-76b979de18e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e] added
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b524d-12d5-4a46-893c-c5a4ae864fcd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9033244-4b28-4dd9-b245-f2b882d154ae]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHNgfYpU {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHNgfYpU" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d99f5d-3559-438b-81f4-83839a0ff6ca]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHNgfYpU'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[13027efc-6317-4fd7-ad44-4c23c4c4ec16]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4efbc-faea-4556-aad5-3863ddfb557f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da66fbc-6020-4413-9aa4-8b2eed829ced]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]
Nov 08 15:44:22 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791b901-093c-44b7-ba76-1fbfeb5da3c0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4001341-1c8e-42b9-a238-e8c5604847c4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:22 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:22 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b415382-d059-4cfe-bfe9-026c6c00933b]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:44:22 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26565346563633838', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565346563633838', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.284s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:23 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:23 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787a580-556f-437b-9e10-9faf4f2ad4de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:44:23 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-148101586',display_name='tempest-TestVolumeBootPattern-server-148101586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-148101586',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-00w0ly7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:25Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:44:23 user nova-compute[74788]:   <uuid>7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e</uuid>
Nov 08 15:44:23 user nova-compute[74788]:   <name>instance-0000002b</name>
Nov 08 15:44:23 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:44:23 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:44:23 user nova-compute[74788]:   <metadata>
Nov 08 15:44:23 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:44:23 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:44:23 user nova-compute[74788]:       <nova:name>tempest-TestVolumeBootPattern-server-148101586</nova:name>
Nov 08 15:44:23 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:44:22</nova:creationTime>
Nov 08 15:44:23 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:44:23 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:44:23 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:44:23 user nova-compute[74788]:       <nova:owner>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:user uuid="9655d103734d485691fe3d82e4e68032">tempest-TestVolumeBootPattern-1548248568-project-member</nova:user>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:project uuid="ef632441d171499280801b367697b620">tempest-TestVolumeBootPattern-1548248568</nova:project>
Nov 08 15:44:23 user nova-compute[74788]:       </nova:owner>
Nov 08 15:44:23 user nova-compute[74788]:       <nova:ports>
Nov 08 15:44:23 user nova-compute[74788]:         <nova:port uuid="59e24d42-8693-4a57-8d60-ff365af5ccb2">
Nov 08 15:44:23 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 15:44:23 user nova-compute[74788]:         </nova:port>
Nov 08 15:44:23 user nova-compute[74788]:       </nova:ports>
Nov 08 15:44:23 user nova-compute[74788]:     </nova:instance>
Nov 08 15:44:23 user nova-compute[74788]:   </metadata>
Nov 08 15:44:23 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:44:23 user nova-compute[74788]:     <system>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="serial">7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e</entry>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="uuid">7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e</entry>
Nov 08 15:44:23 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:44:23 user nova-compute[74788]:     </system>
Nov 08 15:44:23 user nova-compute[74788]:   </sysinfo>
Nov 08 15:44:23 user nova-compute[74788]:   <os>
Nov 08 15:44:23 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:44:23 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:44:23 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:44:23 user nova-compute[74788]:   </os>
Nov 08 15:44:23 user nova-compute[74788]:   <features>
Nov 08 15:44:23 user nova-compute[74788]:     <acpi/>
Nov 08 15:44:23 user nova-compute[74788]:     <apic/>
Nov 08 15:44:23 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:44:23 user nova-compute[74788]:   </features>
Nov 08 15:44:23 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:44:23 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:44:23 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:44:23 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:44:23 user nova-compute[74788]:   </clock>
Nov 08 15:44:23 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:44:23 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:44:23 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:44:23 user nova-compute[74788]:   </cpu>
Nov 08 15:44:23 user nova-compute[74788]:   <devices>
Nov 08 15:44:23 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:44:23 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:44:23 user nova-compute[74788]:       <source dev="/dev/sdd"/>
Nov 08 15:44:23 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:44:23 user nova-compute[74788]:       <serial>00a80a43-2323-40d5-9612-d557ee1fff8e</serial>
Nov 08 15:44:23 user nova-compute[74788]:     </disk>
Nov 08 15:44:23 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:44:23 user nova-compute[74788]:       <mac address="fa:16:3e:ca:e1:3c"/>
Nov 08 15:44:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:44:23 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:44:23 user nova-compute[74788]:       <target dev="tap59e24d42-86"/>
Nov 08 15:44:23 user nova-compute[74788]:     </interface>
Nov 08 15:44:23 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:44:23 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e/console.log" append="off"/>
Nov 08 15:44:23 user nova-compute[74788]:     </serial>
Nov 08 15:44:23 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:44:23 user nova-compute[74788]:     <video>
Nov 08 15:44:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:44:23 user nova-compute[74788]:     </video>
Nov 08 15:44:23 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:44:23 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:44:23 user nova-compute[74788]:     </rng>
Nov 08 15:44:23 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:44:23 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:44:23 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:44:23 user nova-compute[74788]:     </memballoon>
Nov 08 15:44:23 user nova-compute[74788]:   </devices>
Nov 08 15:44:23 user nova-compute[74788]: </domain>
Nov 08 15:44:23 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-148101586',display_name='tempest-TestVolumeBootPattern-server-148101586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-148101586',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-00w0ly7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:25Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_vif [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c6a1f-b72c-4468-aa14-1d66d90f8417]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959] added
Nov 08 15:44:23 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09819c2-265d-5797-b934-206ff28a2f9d', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59e24d42-86, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59e24d42-86, col_values=(('qos', UUID('00b831f3-44a8-4f91-ac89-3a3019d1667a')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59e24d42-86, col_values=(('external_ids', {'iface-id': '59e24d42-8693-4a57-8d60-ff365af5ccb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:e1:3c', 'vm-uuid': '7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:23 user nova-compute[74788]: INFO os_vif [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86')
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad63a9d-7f04-4588-9056-e7cda0450b3e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[651ed2b7-0051-4e7a-b2c2-a4424cce25c5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhDMmeus {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No VIF found with MAC fa:16:3e:ca:e1:3c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhDMmeus" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc221c6a-81d9-4ca8-9391-4db9f8e8d470]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhDMmeus'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb3340c-b3c5-4283-9054-fe6ec23f03b4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e19aad-60c6-4ea4-9a4f-949cc0806e3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e93451-7ad2-43b4-8ecc-31ec68c47d0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260]
Nov 08 15:44:24 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260] successful.
Nov 08 15:44:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[681fd261-81e6-476b-903b-00c78574ec36]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[905ecb52-6b94-474d-b815-5ef86c2d3d02]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:24 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:24 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[65351660-06c6-44f9-9c78-a35dbe062e72]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:24 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== connect_volume: return (2603ms) {'type': 'block', 'scsi_wwn': '26465373239353738', 'path': '/dev/sde'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373239353738', 'path': '/dev/sde'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399064259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399064259',id=45,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ssvoti8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:49Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=ebeaebbb-acd5-4f72-9b11-d81d85eca41f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.objects.instance [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:44:25 user nova-compute[74788]:   <uuid>ebeaebbb-acd5-4f72-9b11-d81d85eca41f</uuid>
Nov 08 15:44:25 user nova-compute[74788]:   <name>instance-0000002d</name>
Nov 08 15:44:25 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:44:25 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:44:25 user nova-compute[74788]:   <metadata>
Nov 08 15:44:25 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:44:25 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-399064259</nova:name>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:44:22</nova:creationTime>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:44:25 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:44:25 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:owner>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:44:25 user nova-compute[74788]:       </nova:owner>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:44:25 user nova-compute[74788]:       <nova:ports>
Nov 08 15:44:25 user nova-compute[74788]:         <nova:port uuid="19755a1e-b211-471d-b8ba-42d4e663ca6a">
Nov 08 15:44:25 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:44:25 user nova-compute[74788]:         </nova:port>
Nov 08 15:44:25 user nova-compute[74788]:       </nova:ports>
Nov 08 15:44:25 user nova-compute[74788]:     </nova:instance>
Nov 08 15:44:25 user nova-compute[74788]:   </metadata>
Nov 08 15:44:25 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:44:25 user nova-compute[74788]:     <system>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="serial">ebeaebbb-acd5-4f72-9b11-d81d85eca41f</entry>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="uuid">ebeaebbb-acd5-4f72-9b11-d81d85eca41f</entry>
Nov 08 15:44:25 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:44:25 user nova-compute[74788]:     </system>
Nov 08 15:44:25 user nova-compute[74788]:   </sysinfo>
Nov 08 15:44:25 user nova-compute[74788]:   <os>
Nov 08 15:44:25 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:44:25 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:44:25 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:44:25 user nova-compute[74788]:   </os>
Nov 08 15:44:25 user nova-compute[74788]:   <features>
Nov 08 15:44:25 user nova-compute[74788]:     <acpi/>
Nov 08 15:44:25 user nova-compute[74788]:     <apic/>
Nov 08 15:44:25 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:44:25 user nova-compute[74788]:   </features>
Nov 08 15:44:25 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:44:25 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:44:25 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:44:25 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:44:25 user nova-compute[74788]:   </clock>
Nov 08 15:44:25 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:44:25 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:44:25 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:44:25 user nova-compute[74788]:   </cpu>
Nov 08 15:44:25 user nova-compute[74788]:   <devices>
Nov 08 15:44:25 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:44:25 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:44:25 user nova-compute[74788]:       <source dev="/dev/sde"/>
Nov 08 15:44:25 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:44:25 user nova-compute[74788]:       <serial>469c5642-1a5b-4433-8cc7-5eb379463959</serial>
Nov 08 15:44:25 user nova-compute[74788]:     </disk>
Nov 08 15:44:25 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:44:25 user nova-compute[74788]:       <mac address="fa:16:3e:70:c0:88"/>
Nov 08 15:44:25 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:44:25 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:44:25 user nova-compute[74788]:       <target dev="tap19755a1e-b2"/>
Nov 08 15:44:25 user nova-compute[74788]:     </interface>
Nov 08 15:44:25 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:44:25 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/console.log" append="off"/>
Nov 08 15:44:25 user nova-compute[74788]:     </serial>
Nov 08 15:44:25 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:44:25 user nova-compute[74788]:     <video>
Nov 08 15:44:25 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:44:25 user nova-compute[74788]:     </video>
Nov 08 15:44:25 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:44:25 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:44:25 user nova-compute[74788]:     </rng>
Nov 08 15:44:25 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:44:25 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:44:25 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:44:25 user nova-compute[74788]:     </memballoon>
Nov 08 15:44:25 user nova-compute[74788]:   </devices>
Nov 08 15:44:25 user nova-compute[74788]: </domain>
Nov 08 15:44:25 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399064259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399064259',id=45,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ssvoti8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:43:49Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=ebeaebbb-acd5-4f72-9b11-d81d85eca41f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG os_vif [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81392f01-7363-509f-a1fd-a249b525eaea', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19755a1e-b2, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19755a1e-b2, col_values=(('qos', UUID('22cdcab3-73ae-4dd1-89f0-473cc69bd5db')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19755a1e-b2, col_values=(('external_ids', {'iface-id': '19755a1e-b211-471d-b8ba-42d4e663ca6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c0:88', 'vm-uuid': 'ebeaebbb-acd5-4f72-9b11-d81d85eca41f'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: INFO os_vif [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2')
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:70:c0:88, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] No waiting events found dispatching network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:25 user nova-compute[74788]: WARNING nova.compute.manager [req-4eadcd69-6f20-4b93-b4a5-6782564232ef req-22203f4d-15e5-4159-b3d1-f97281771da3 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received unexpected event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 for instance with vm_state building and task_state spawning.
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:27 user nova-compute[74788]: WARNING nova.compute.manager [req-9643085c-a16c-418f-aefb-01027869ffa5 req-1eadc5ea-d517-4fdb-b868-59a663d1cf14 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state building and task_state spawning.
Nov 08 15:44:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] No waiting events found dispatching network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:27 user nova-compute[74788]: WARNING nova.compute.manager [req-17fcef1a-5399-424b-ac96-9cf9b3826d58 req-d63f4a40-bbbb-48ad-86eb-e5d2a87c86c2 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received unexpected event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 for instance with vm_state building and task_state spawning.
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:44:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Instance spawned successfully.
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:28 user nova-compute[74788]: INFO nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 08 15:44:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:44:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:28 user nova-compute[74788]: INFO nova.compute.manager [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Took 64.09 seconds to build instance.
Nov 08 15:44:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-7328d8e6-fd21-479e-829b-aab394770109 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.193s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:44:29 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance spawned successfully.
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:44:29 user nova-compute[74788]: INFO nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:29 user nova-compute[74788]: DEBUG nova.compute.manager [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:29 user nova-compute[74788]: WARNING nova.compute.manager [req-7954a383-3983-4d03-874c-442c73e89c69 req-60e6f323-f03c-43f8-a63c-9af80003358f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state building and task_state spawning.
Nov 08 15:44:29 user nova-compute[74788]: INFO nova.compute.manager [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Took 41.34 seconds to build instance.
Nov 08 15:44:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-00d853fe-0523-465a-923c-3aaa0f777646 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.451s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:34 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6077b7d-a6eb-43e3-889f-2eb61708119e is timed out.
Nov 08 15:44:34 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully detached device vdb from instance b6077b7d-a6eb-43e3-889f-2eb61708119e from the live domain config.
Nov 08 15:44:34 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvLwigoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:44:34 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[45877164-cb9d-48de-950f-b9b7d5c64e5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:44:34 user nova-compute[74788]: No targets found.
Nov 08 15:44:34 user nova-compute[74788]: iSNS:
Nov 08 15:44:34 user nova-compute[74788]: No targets found.
Nov 08 15:44:34 user nova-compute[74788]: STATIC:
Nov 08 15:44:34 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5
Nov 08 15:44:34 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:34 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:34 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca
Nov 08 15:44:34 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:34 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:34 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:44:34 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:34 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:34 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:44:34 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:34 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:34 user nova-compute[74788]: FIRMWARE:
Nov 08 15:44:34 user nova-compute[74788]: No targets found.
Nov 08 15:44:34 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:44:34 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:44:34 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b7f49-bda4-4fec-8460-13b4ef153940]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9241a9-d833-49a6-8f80-c07c84178389]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:34 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:34 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:34 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585adab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe9c739-bf18-4986-83dd-3dc56f3998d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f179c6-efcc-409c-bf92-f111d98f750e]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2223de64-7851-4b9d-a847-96f3c5b15f78]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a209e4-639b-4e5b-84bf-87561671accb]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ffa40c-61d6-4ae6-9cb8-f12eceb99b42]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:34 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca96729-271d-499e-a3ca-d20f303ba87b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260]
Nov 08 15:44:35 user nova-compute[74788]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5, portal: 172.16.0.220,3260] successful.
Nov 08 15:44:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051d7a5-86be-4f3b-bd4d-579c46269210]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== disconnect_volume: return (313ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:44:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8deba230-daa9-4fb9-abe7-e06a71d22f1b tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.033s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.877s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:36 user nova-compute[74788]: INFO nova.compute.manager [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Terminating instance
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-3c271ae9-8233-4ac1-a366-f75942bade6e req-e432c5a1-c5b7-40aa-b58d-a45f721b034e service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:36 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Instance destroyed successfully.
Nov 08 15:44:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'resources' on Instance uuid b6077b7d-a6eb-43e3-889f-2eb61708119e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-207086023',display_name='tempest-VolumesSnapshotTestJSON-instance-207086023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-207086023',id=41,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfdwdnY8xI5luSf30Bg62hJhIRnQb7vL53DCpccCtBM4Jy1t00IIQAxo1VOHFkAtWc6rOCt1iwIRGouw8E1rUcdzNib9Q5qULnItKcILprsRw1Oj5OEwFa9W7bgLTlZAg==',key_name='tempest-keypair-1355616051',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-gwrx4wkh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:40:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=b6077b7d-a6eb-43e3-889f-2eb61708119e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "address": "fa:16:3e:e9:37:19", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b26b1ed-f7", "ovs_interfaceid": "5b26b1ed-f7be-40ed-8572-ffb933ee61b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_vif [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b26b1ed-f7, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64148bc9-9555-47d4-a27c-77c699d0b820) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: INFO os_vif [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:37:19,bridge_name='br-int',has_traffic_filtering=True,id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b26b1ed-f7')
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvLwigoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:44:37 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c017462-0c73-4120-9d36-954a6bece6d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:44:37 user nova-compute[74788]: No targets found.
Nov 08 15:44:37 user nova-compute[74788]: iSNS:
Nov 08 15:44:37 user nova-compute[74788]: No targets found.
Nov 08 15:44:37 user nova-compute[74788]: STATIC:
Nov 08 15:44:37 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca
Nov 08 15:44:37 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:37 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:37 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:44:37 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:37 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:37 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:44:37 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:44:37 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:44:37 user nova-compute[74788]: FIRMWARE:
Nov 08 15:44:37 user nova-compute[74788]: No targets found.
Nov 08 15:44:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:44:37 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:44:37 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faf762e2-9aad-4df8-b7f3-988abe6033e5', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd22207-f559-463e-990b-4d58fdfdae66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab91929-d576-4d5d-bcf8-ea4f9e711874]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:37 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:37 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:155ccc13-9d1f-4343-aa02-3fb2f76c85ca (non-flash)
Nov 08 15:44:37 user nova-compute[74788]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:44:37 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:44:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758501480>, {}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Disconnecting from: [] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== disconnect_volume: return (80ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:44:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Deleting instance files /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e_del
Nov 08 15:44:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Deletion of /opt/stack/data/nova/instances/b6077b7d-a6eb-43e3-889f-2eb61708119e_del complete
Nov 08 15:44:37 user nova-compute[74788]: INFO nova.compute.manager [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 15:44:37 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:44:38 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Took 0.95 seconds to deallocate network for instance.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-840b21c0-06fc-48f0-9b67-0ea0740cc1e4 req-37959eef-4857-477a-9c75-2d68bcac60dd service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-deleted-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: INFO nova.compute.manager [req-840b21c0-06fc-48f0-9b67-0ea0740cc1e4 req-37959eef-4857-477a-9c75-2d68bcac60dd service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Neutron deleted interface 5b26b1ed-f7be-40ed-8572-ffb933ee61b5; detaching it from the instance and deleting it from the info cache
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-840b21c0-06fc-48f0-9b67-0ea0740cc1e4 req-37959eef-4857-477a-9c75-2d68bcac60dd service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.volume.cinder [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Attachment e7765414-0305-4598-ac5e-2f34ca4e8abc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e7765414-0305-4598-ac5e-2f34ca4e8abc. (HTTP 404) (Request-ID: req-ba9cd4da-c199-4c54-8b7c-981d3870c141)
Nov 08 15:44:38 user nova-compute[74788]: INFO nova.compute.manager [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-840b21c0-06fc-48f0-9b67-0ea0740cc1e4 req-37959eef-4857-477a-9c75-2d68bcac60dd service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Detach interface failed, port_id=5b26b1ed-f7be-40ed-8572-ffb933ee61b5, reason: Instance b6077b7d-a6eb-43e3-889f-2eb61708119e could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Deleted allocations for instance b6077b7d-a6eb-43e3-889f-2eb61708119e
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-588e4c4b-2bc2-4519-9b8f-aa0018724915 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state deleted and task_state None.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state deleted and task_state None.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state deleted and task_state None.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-unplugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state deleted and task_state None.
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Acquiring lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] Lock "b6077b7d-a6eb-43e3-889f-2eb61708119e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] No waiting events found dispatching network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:44:38 user nova-compute[74788]: WARNING nova.compute.manager [req-f31528ab-f88e-4c09-8bde-deb70386b512 req-a436fa75-7537-4c8b-bacf-42e28456e75d service nova] [instance: b6077b7d-a6eb-43e3-889f-2eb61708119e] Received unexpected event network-vif-plugged-5b26b1ed-f7be-40ed-8572-ffb933ee61b5 for instance with vm_state deleted and task_state None.
Nov 08 15:44:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:44:56 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:44:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:57 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:44:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:44:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:44:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:44:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:59 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:44:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:44:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:44:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:44:59 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:45:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:45:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:45:01 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=25.247257232666016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3a2d396e-1663-41c0-8437-3d8ed419d3de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:45:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:45:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:45:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:45:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-changed-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Refreshing instance network info cache due to event network-changed-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] Acquiring lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] Acquired lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG nova.network.neutron [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Refreshing network info cache for port a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG nova.network.neutron [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updated VIF entry in instance network info cache for port a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG nova.network.neutron [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:45:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-613deab4-8179-4651-b243-3cd2af5bfe63 req-d1c73f66-e09d-4b7e-968d-ba16477c3ba9 service nova] Releasing lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:45:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:45:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:38 user nova-compute[74788]: INFO nova.compute.manager [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Rescuing
Nov 08 15:45:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:45:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:45:38 user nova-compute[74788]: DEBUG nova.network.neutron [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG nova.network.neutron [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:45:39 user nova-compute[74788]: WARNING nova.compute.manager [req-826feac7-ac40-4eac-b80d-b375efaf02b5 req-61bf4ac6-c880-470c-a25d-51d4d84de12a service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state rescuing.
Nov 08 15:45:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance destroyed successfully.
Nov 08 15:45:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Attempting a stable device rescue
Nov 08 15:45:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:45:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Creating image(s)
Nov 08 15:45:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'trusted_certs' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG nova.virt.images [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] 1bea31dc-b664-4bac-88b2-19e0454be737 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.part /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:45:41 user nova-compute[74788]: WARNING nova.compute.manager [req-348e1508-9253-46f3-abf6-e8d065a34a10 req-01153854-84ca-4087-a966-689dec220c80 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state rescuing.
Nov 08 15:45:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.part /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.converted" returned: 0 in 0.540s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.202s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2 --force-share --output=json" returned: 0 in 0.213s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2,backing_fmt=raw /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2,backing_fmt=raw /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue" returned: 0 in 0.051s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "57e809caa4fa4b05862dfacc888c3d428fd6def2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'migration_context' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<ebeaebbb-acd5-4f72-9b11-d81d85eca41f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start _get_guest_xml network_info=[{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:70:c0:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1bea31dc-b664-4bac-88b2-19e0454be737', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ebeaebbb-acd5-4f72-9b11-d81d85eca41f', 'attached_at': '', 'detached_at': '', 'volume_id': '469c5642-1a5b-4433-8cc7-5eb379463959', 'serial': '469c5642-1a5b-4433-8cc7-5eb379463959'}, 'attachment_id': 'bfdceda5-e26a-43ca-ae83-d05cce79f372', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<ebeaebbb-acd5-4f72-9b11-d81d85eca41f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'numa_topology' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<ebeaebbb-acd5-4f72-9b11-d81d85eca41f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:45:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:45:42 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.objects.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<ebeaebbb-acd5-4f72-9b11-d81d85eca41f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:45:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:45:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:45:42 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe648c3c-d7ed-4049-8815-0279c09eeda4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fhDMmeus\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 15:45:42 user nova-compute[74788]: node.name = iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:45:42 user nova-compute[74788]: node.tpgt = -1
Nov 08 15:45:42 user nova-compute[74788]: node.startup = automatic
Nov 08 15:45:42 user nova-compute[74788]: node.leading_login = No
Nov 08 15:45:42 user nova-compute[74788]: iface.iscsi_ifacename = default
Nov 08 15:45:42 user nova-compute[74788]: iface.net_ifacename = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.ipaddress = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.prefix_len = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.hwaddress = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.transport_name = tcp
Nov 08 15:45:42 user nova-compute[74788]: iface.initiatorname = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.vlan_id = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.vlan_priority = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.vlan_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.iface_num = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.mtu = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.port = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.bootproto = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.subnet_mask = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.gateway = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_alt_client_id = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_dns = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_learn_iqn = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_vendor_id_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_vendor_id = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.dhcp_slp_da = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.fragmentation = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.gratuitous_arp = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.incoming_forwarding = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.tos_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.tos = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.ttl = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.delayed_ack = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.tcp_nagle = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.tcp_wsf_state = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.tcp_wsf = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.tcp_timer_scale = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.tcp_timestamp = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.redirect = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.def_task_mgmt_timeout = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.header_digest = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.data_digest = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.immediate_data = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.initial_r2t = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.data_seq_inorder = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.data_pdu_inorder = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.erl = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.max_receive_data_len = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.first_burst_len = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.max_outstanding_r2t = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.max_burst_len = 0
Nov 08 15:45:42 user nova-compute[74788]: iface.chap_auth = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.bidi_chap = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.strict_login_compliance = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.discovery_auth = <empty>
Nov 08 15:45:42 user nova-compute[74788]: iface.discovery_logout = <empty>
Nov 08 15:45:42 user nova-compute[74788]: node.discovery_address = <empty>
Nov 08 15:45:42 user nova-compute[74788]: node.discovery_port = 0
Nov 08 15:45:42 user nova-compute[74788]: node.discovery_type = static
Nov 08 15:45:42 user nova-compute[74788]: node.session.initial_cmdsn = 0
Nov 08 15:45:42 user nova-compute[74788]: node.session.initial_login_retry_max = 8
Nov 08 15:45:42 user nova-compute[74788]: node.session.xmit_thread_priority = -20
Nov 08 15:45:42 user nova-compute[74788]: node.session.cmds_max = 128
Nov 08 15:45:42 user nova-compute[74788]: node.session.queue_depth = 32
Nov 08 15:45:42 user nova-compute[74788]: node.session.nr_sessions = 1
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.authmethod = CHAP
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.username = fhDMmeus
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.password = ***
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.username_in = <empty>
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.password_in = <empty>
Nov 08 15:45:42 user nova-compute[74788]: node.session.auth.chap_algs = MD5
Nov 08 15:45:42 user nova-compute[74788]: node.session.timeo.replacement_timeout = 120
Nov 08 15:45:42 user nova-compute[74788]: node.session.err_timeo.abort_timeout = 15
Nov 08 15:45:42 user nova-compute[74788]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 15:45:42 user nova-compute[74788]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 15:45:42 user nova-compute[74788]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.FastAbort = Yes
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.InitialR2T = No
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.ImmediateData = Yes
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.MaxConnections = 1
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 15:45:42 user nova-compute[74788]: node.session.iscsi.ERL = 0
Nov 08 15:45:42 user nova-compute[74788]: node.session.scan = manual
Nov 08 15:45:42 user nova-compute[74788]: node.session.reopen_max = 0
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].address = 172.16.0.220
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].port = 3260
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].startup = manual
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].tcp.window_size = 524288
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].tcp.type_of_service = 0
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].timeo.logout_timeout = 15
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].timeo.login_timeout = 15
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].timeo.auth_timeout = 45
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.DataDigest = None
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.IFMarker = No
Nov 08 15:45:42 user nova-compute[74788]: node.conn[0].iscsi.OFMarker = No
Nov 08 15:45:42 user nova-compute[74788]: # END RECORD
Nov 08 15:45:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b9faf9-5ab3-4d14-80ca-3d52c3274215]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd300e9d-02c1-4e2f-a6bf-e41db7082714]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhDMmeus {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhDMmeus" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb5bbb-542c-45c8-87b0-928e6499ded1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhDMmeus'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef22437-cd48-42a3-9994-bfe50905afc1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d097669-d845-43d9-b6a7-e74c533b24c0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:45:42 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:45:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:45:42 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:45:42 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] HCTL ('36', '0', '0', 0) found on session 47 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:45:42 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b913f-ed64-4469-ae43-8e517edf13f8]: (4, ('0 0 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching for a device in session 47 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.156s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== connect_volume: return (157ms) {'type': 'block', 'scsi_wwn': '26465373239353738', 'path': '/dev/sde'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373239353738', 'path': '/dev/sde'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399064259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399064259',id=45,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ssvoti8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:44:29Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=ebeaebbb-acd5-4f72-9b11-d81d85eca41f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:70:c0:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:70:c0:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.objects.base [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<ebeaebbb-acd5-4f72-9b11-d81d85eca41f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:45:43 user nova-compute[74788]:   <uuid>ebeaebbb-acd5-4f72-9b11-d81d85eca41f</uuid>
Nov 08 15:45:43 user nova-compute[74788]:   <name>instance-0000002d</name>
Nov 08 15:45:43 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:45:43 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:45:43 user nova-compute[74788]:   <metadata>
Nov 08 15:45:43 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:45:43 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-399064259</nova:name>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:45:42</nova:creationTime>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:45:43 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:45:43 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:owner>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:45:43 user nova-compute[74788]:       </nova:owner>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:45:43 user nova-compute[74788]:       <nova:ports>
Nov 08 15:45:43 user nova-compute[74788]:         <nova:port uuid="19755a1e-b211-471d-b8ba-42d4e663ca6a">
Nov 08 15:45:43 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:45:43 user nova-compute[74788]:         </nova:port>
Nov 08 15:45:43 user nova-compute[74788]:       </nova:ports>
Nov 08 15:45:43 user nova-compute[74788]:     </nova:instance>
Nov 08 15:45:43 user nova-compute[74788]:   </metadata>
Nov 08 15:45:43 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:45:43 user nova-compute[74788]:     <system>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="serial">ebeaebbb-acd5-4f72-9b11-d81d85eca41f</entry>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="uuid">ebeaebbb-acd5-4f72-9b11-d81d85eca41f</entry>
Nov 08 15:45:43 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:45:43 user nova-compute[74788]:     </system>
Nov 08 15:45:43 user nova-compute[74788]:   </sysinfo>
Nov 08 15:45:43 user nova-compute[74788]:   <os>
Nov 08 15:45:43 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:45:43 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:45:43 user nova-compute[74788]:   </os>
Nov 08 15:45:43 user nova-compute[74788]:   <features>
Nov 08 15:45:43 user nova-compute[74788]:     <acpi/>
Nov 08 15:45:43 user nova-compute[74788]:     <apic/>
Nov 08 15:45:43 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:45:43 user nova-compute[74788]:   </features>
Nov 08 15:45:43 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:45:43 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:45:43 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:45:43 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:45:43 user nova-compute[74788]:   </clock>
Nov 08 15:45:43 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:45:43 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:45:43 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:45:43 user nova-compute[74788]:   </cpu>
Nov 08 15:45:43 user nova-compute[74788]:   <devices>
Nov 08 15:45:43 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:45:43 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:45:43 user nova-compute[74788]:       <source dev="/dev/sde"/>
Nov 08 15:45:43 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:45:43 user nova-compute[74788]:       <serial>469c5642-1a5b-4433-8cc7-5eb379463959</serial>
Nov 08 15:45:43 user nova-compute[74788]:     </disk>
Nov 08 15:45:43 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:45:43 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:45:43 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue"/>
Nov 08 15:45:43 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:45:43 user nova-compute[74788]:       <boot order="1"/>
Nov 08 15:45:43 user nova-compute[74788]:     </disk>
Nov 08 15:45:43 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:45:43 user nova-compute[74788]:       <mac address="fa:16:3e:70:c0:88"/>
Nov 08 15:45:43 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:45:43 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:45:43 user nova-compute[74788]:       <target dev="tap19755a1e-b2"/>
Nov 08 15:45:43 user nova-compute[74788]:     </interface>
Nov 08 15:45:43 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:45:43 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/console.log" append="off"/>
Nov 08 15:45:43 user nova-compute[74788]:     </serial>
Nov 08 15:45:43 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:45:43 user nova-compute[74788]:     <video>
Nov 08 15:45:43 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:45:43 user nova-compute[74788]:     </video>
Nov 08 15:45:43 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:45:43 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:45:43 user nova-compute[74788]:     </rng>
Nov 08 15:45:43 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:45:43 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:45:43 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:45:43 user nova-compute[74788]:     </memballoon>
Nov 08 15:45:43 user nova-compute[74788]:   </devices>
Nov 08 15:45:43 user nova-compute[74788]: </domain>
Nov 08 15:45:43 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:45:43 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance destroyed successfully.
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:45:43 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:70:c0:88, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:45:44 user nova-compute[74788]: WARNING nova.compute.manager [req-11393132-b060-47d1-a0b5-16aaf0bc070b req-b3ef0cc0-2b55-45bc-b510-885798af1307 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state rescuing.
Nov 08 15:45:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:45:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:46 user nova-compute[74788]: INFO nova.compute.manager [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Attaching volume 64884d9b-df19-4edc-8da8-f1e3c198aa6e to /dev/vdb
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.utils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d1e439-0a26-433f-9c45-ad280e73b728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2601c1c-1205-47e2-a15d-53c996e85d8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b81580-7dab-4b68-9af4-d5241aebd886]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76eca5-97cd-4bd7-be1c-05d255c3e08b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:45:46 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c54626a-9bad-4392-8699-f911f770bfee]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG os_brick.utils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating existing volume attachment record: 239d18d5-0947-4b32-8555-b840d67e76e4 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:45:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:45:46 user nova-compute[74788]: WARNING nova.compute.manager [req-6ceed069-23c1-4eb9-b5a0-23f471f19fcd req-81812756-2a10-4a9f-baf5-924da8820d5f service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state rescuing.
Nov 08 15:45:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-824e6b16-7f72-4afb-af20-375c5b44c851 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:45:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:45:53 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:45:57 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:45:58 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:45:59 user nova-compute[74788]: INFO nova.compute.claims [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Claim successful on node user
Nov 08 15:45:59 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:45:59 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:46:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.policy [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fe699714bde4a5f9a726d0d43695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b242b447c4d4e49abf8d4df70317aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:46:00 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Creating image(s)
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "/opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "/opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "/opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.029s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:00 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.210s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk 1073741824" returned: 0 in 0.062s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Successfully created port: 502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Cannot resize image /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Ensure instance console log exists: /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Successfully updated port: 502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquired lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-changed-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Refreshing instance network info cache due to event network-changed-502e1735-5caa-4b1d-9e39-69024ec321ff. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:46:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] Acquiring lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updating instance_info_cache with network_info: [{"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Releasing lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Instance network_info: |[{"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] Acquired lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Refreshing network info cache for port 502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Start _get_guest_xml network_info=[{"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:46:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:46:02 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1257982106',display_name='tempest-VolumesSnapshotTestJSON-instance-1257982106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1257982106',id=46,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI9Xi8XkVFkNoMOHvWT+PTLNOfWd/XoSwFhe4FxKwMFOwFRcLYSExZtHrMubi/Q3UWo84oYa+D7qwK/0ko7aXnOhZiJVzKy+yVsxYB9BzFvmsyVUXmXjg7lERmLMr3Dzg==',key_name='tempest-keypair-1252390224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-g0j3srsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=dade6ce0-46fb-4340-bbec-50135625436f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'pci_devices' on Instance uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:46:02 user nova-compute[74788]:   <uuid>dade6ce0-46fb-4340-bbec-50135625436f</uuid>
Nov 08 15:46:02 user nova-compute[74788]:   <name>instance-0000002e</name>
Nov 08 15:46:02 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:46:02 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:46:02 user nova-compute[74788]:   <metadata>
Nov 08 15:46:02 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:46:02 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1257982106</nova:name>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:46:02</nova:creationTime>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:46:02 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:46:02 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:owner>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:user uuid="5fe699714bde4a5f9a726d0d43695be2">tempest-VolumesSnapshotTestJSON-1290769345-project-member</nova:user>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:project uuid="2b242b447c4d4e49abf8d4df70317aad">tempest-VolumesSnapshotTestJSON-1290769345</nova:project>
Nov 08 15:46:02 user nova-compute[74788]:       </nova:owner>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:46:02 user nova-compute[74788]:       <nova:ports>
Nov 08 15:46:02 user nova-compute[74788]:         <nova:port uuid="502e1735-5caa-4b1d-9e39-69024ec321ff">
Nov 08 15:46:02 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 15:46:02 user nova-compute[74788]:         </nova:port>
Nov 08 15:46:02 user nova-compute[74788]:       </nova:ports>
Nov 08 15:46:02 user nova-compute[74788]:     </nova:instance>
Nov 08 15:46:02 user nova-compute[74788]:   </metadata>
Nov 08 15:46:02 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:46:02 user nova-compute[74788]:     <system>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="serial">dade6ce0-46fb-4340-bbec-50135625436f</entry>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="uuid">dade6ce0-46fb-4340-bbec-50135625436f</entry>
Nov 08 15:46:02 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:46:02 user nova-compute[74788]:     </system>
Nov 08 15:46:02 user nova-compute[74788]:   </sysinfo>
Nov 08 15:46:02 user nova-compute[74788]:   <os>
Nov 08 15:46:02 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:46:02 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:46:02 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:46:02 user nova-compute[74788]:   </os>
Nov 08 15:46:02 user nova-compute[74788]:   <features>
Nov 08 15:46:02 user nova-compute[74788]:     <acpi/>
Nov 08 15:46:02 user nova-compute[74788]:     <apic/>
Nov 08 15:46:02 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:46:02 user nova-compute[74788]:   </features>
Nov 08 15:46:02 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:46:02 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:46:02 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:46:02 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:46:02 user nova-compute[74788]:   </clock>
Nov 08 15:46:02 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:46:02 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:46:02 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:46:02 user nova-compute[74788]:   </cpu>
Nov 08 15:46:02 user nova-compute[74788]:   <devices>
Nov 08 15:46:02 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:46:02 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:46:02 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk"/>
Nov 08 15:46:02 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:46:02 user nova-compute[74788]:     </disk>
Nov 08 15:46:02 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:46:02 user nova-compute[74788]:       <mac address="fa:16:3e:31:8d:17"/>
Nov 08 15:46:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:46:02 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:46:02 user nova-compute[74788]:       <target dev="tap502e1735-5c"/>
Nov 08 15:46:02 user nova-compute[74788]:     </interface>
Nov 08 15:46:02 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:46:02 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/console.log" append="off"/>
Nov 08 15:46:02 user nova-compute[74788]:     </serial>
Nov 08 15:46:02 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:46:02 user nova-compute[74788]:     <video>
Nov 08 15:46:02 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:46:02 user nova-compute[74788]:     </video>
Nov 08 15:46:02 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:46:02 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:46:02 user nova-compute[74788]:     </rng>
Nov 08 15:46:02 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:46:02 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:46:02 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:46:02 user nova-compute[74788]:     </memballoon>
Nov 08 15:46:02 user nova-compute[74788]:   </devices>
Nov 08 15:46:02 user nova-compute[74788]: </domain>
Nov 08 15:46:02 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1257982106',display_name='tempest-VolumesSnapshotTestJSON-instance-1257982106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1257982106',id=46,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI9Xi8XkVFkNoMOHvWT+PTLNOfWd/XoSwFhe4FxKwMFOwFRcLYSExZtHrMubi/Q3UWo84oYa+D7qwK/0ko7aXnOhZiJVzKy+yVsxYB9BzFvmsyVUXmXjg7lERmLMr3Dzg==',key_name='tempest-keypair-1252390224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-g0j3srsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=dade6ce0-46fb-4340-bbec-50135625436f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG os_vif [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffea1cee-d1c6-544b-8a5f-7b149315911f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap502e1735-5c, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap502e1735-5c, col_values=(('qos', UUID('c5eb2353-7cb1-40fe-b8ea-f02a49915665')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap502e1735-5c, col_values=(('external_ids', {'iface-id': '502e1735-5caa-4b1d-9e39-69024ec321ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:8d:17', 'vm-uuid': 'dade6ce0-46fb-4340-bbec-50135625436f'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:02 user nova-compute[74788]: INFO os_vif [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c')
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No VIF found with MAC fa:16:3e:31:8d:17, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updated VIF entry in instance network info cache for port 502e1735-5caa-4b1d-9e39-69024ec321ff. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.network.neutron [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updating instance_info_cache with network_info: [{"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-011bcc5a-549b-4755-b02c-6e12d84f3d01 req-6038b790-fbfa-4b7b-ab25-8a05aa493e8e service nova] Releasing lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:46:02 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:03 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:46:03 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=25.148338317871094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3a2d396e-1663-41c0-8437-3d8ed419d3de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance dade6ce0-46fb-4340-bbec-50135625436f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG nova.compute.manager [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] No waiting events found dispatching network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:46:04 user nova-compute[74788]: WARNING nova.compute.manager [req-11fc9e78-9a3f-4b87-b143-071bbd339548 req-49e22977-fc88-4853-b4c3-f07191221f20 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received unexpected event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff for instance with vm_state building and task_state spawning.
Nov 08 15:46:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:46:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Instance spawned successfully.
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] No waiting events found dispatching network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:46:06 user nova-compute[74788]: WARNING nova.compute.manager [req-bd93dd37-f75b-4ad0-b990-d6ad740724f1 req-8e7082fa-16ad-456e-96d1-11bba1e74780 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received unexpected event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff for instance with vm_state building and task_state spawning.
Nov 08 15:46:06 user nova-compute[74788]: INFO nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 08 15:46:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:46:06 user nova-compute[74788]: INFO nova.compute.manager [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Took 6.64 seconds to build instance.
Nov 08 15:46:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-87684af6-46bb-4651-9d42-41e2600916f5 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.760s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG nova.compute.manager [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing instance network info cache due to event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] Acquiring lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] Acquired lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG nova.network.neutron [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG nova.network.neutron [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updated VIF entry in instance network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG nova.network.neutron [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:46:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d04143e8-8244-4f3b-b9b2-d3ffe4032950 req-63b0f6fd-36a1-430c-a2e5-66827cb302a6 service nova] Releasing lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:46:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIFVNCpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:46:11 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:46:11 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:46:11 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b1855-6e6d-4081-b109-251ada62b5e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:46:11 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb56fb5-78fe-4390-bd78-ed9ae9559667]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e] added
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[16606bea-4687-4932-b0d7-e31ac71da40f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181d382-6e7d-4759-8ac6-788ad73b3e88]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AIFVNCpU {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AIFVNCpU" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf5465-211d-40b0-914a-6c9e3afb96f0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AIFVNCpU'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da54d2-4713-46a0-b555-7602da316dfe]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6721cd-6ec3-47a9-afdf-39283f758c04]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed31f3b-7259-4507-9706-70241f642b3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260]
Nov 08 15:46:11 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260] successful.
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e26f3-b132-4ba6-a18b-16147bb93453]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[477be9a9-6738-40c9-8b45-b9be47f5cb9e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:11 user nova-compute[74788]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)
Nov 08 15:46:11 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef9341-c670-43ad-8c30-98e245bba2f1]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:46:11 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIFVNCpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23465666263666562', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465666263666562', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:46:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:46:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:46:12 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:46:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:46:12 user nova-compute[74788]:   <serial>64884d9b-df19-4edc-8da8-f1e3c198aa6e</serial>
Nov 08 15:46:12 user nova-compute[74788]: </disk>
Nov 08 15:46:12 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:46:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:46:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:46:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] No VIF found with MAC fa:16:3e:f5:b2:e4, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:46:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-e213a1c7-8fab-422c-88cd-90e21d7034a6 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.272s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:14 user nova-compute[74788]: INFO nova.compute.manager [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Detaching volume 64884d9b-df19-4edc-8da8-f1e3c198aa6e
Nov 08 15:46:14 user nova-compute[74788]: INFO nova.virt.block_device [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Attempting to driver detach volume 64884d9b-df19-4edc-8da8-f1e3c198aa6e from mountpoint /dev/vdb
Nov 08 15:46:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Attempting to detach device vdb from instance 3a2d396e-1663-41c0-8437-3d8ed419d3de from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:46:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:46:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:46:14 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:46:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:46:14 user nova-compute[74788]:   <serial>64884d9b-df19-4edc-8da8-f1e3c198aa6e</serial>
Nov 08 15:46:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:46:14 user nova-compute[74788]: </disk>
Nov 08 15:46:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:46:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance 3a2d396e-1663-41c0-8437-3d8ed419d3de from the persistent domain config.
Nov 08 15:46:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a2d396e-1663-41c0-8437-3d8ed419d3de from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:46:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:46:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:46:14 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 15:46:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:46:14 user nova-compute[74788]:   <serial>64884d9b-df19-4edc-8da8-f1e3c198aa6e</serial>
Nov 08 15:46:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:46:14 user nova-compute[74788]: </disk>
Nov 08 15:46:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:46:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:46:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a2d396e-1663-41c0-8437-3d8ed419d3de is timed out.
Nov 08 15:46:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully detached device vdb from instance 3a2d396e-1663-41c0-8437-3d8ed419d3de from the live domain config.
Nov 08 15:46:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIFVNCpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:46:35 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed3da6-3379-4035-bdce-f0e078a3b46c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:46:35 user nova-compute[74788]: No targets found.
Nov 08 15:46:35 user nova-compute[74788]: iSNS:
Nov 08 15:46:35 user nova-compute[74788]: No targets found.
Nov 08 15:46:35 user nova-compute[74788]: STATIC:
Nov 08 15:46:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:46:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:46:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:46:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:46:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:46:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:46:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e
Nov 08 15:46:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:46:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:46:35 user nova-compute[74788]: FIRMWARE:
Nov 08 15:46:35 user nova-compute[74788]: No targets found.
Nov 08 15:46:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:46:35 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:46:35 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42512c72-3896-4f0c-a671-5d717954641e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[048103eb-f1c0-46ca-a894-8b1c1a7a34e0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:35 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:35 user nova-compute[74788]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)
Nov 08 15:46:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:46:35 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:46:35 user nova-compute[74788]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e (non-flash)
Nov 08 15:46:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758469240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc03f81-01fc-4341-9382-6b729e428e0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d8102-aba8-46cc-914f-5d1cce9783fc]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837cf78-a133-4c97-b0a5-5b74a80ba63a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23939a86-100c-4577-bd6b-2ed65fb5f849]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd5571-4f51-4481-b558-beea5bff7a9d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[342878ab-7832-4eff-bda4-30496d20c69f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260]
Nov 08 15:46:35 user nova-compute[74788]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e, portal: 172.16.0.220,3260] successful.
Nov 08 15:46:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64884d9b-df19-4edc-8da8-f1e3c198aa6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[439467d1-69c6-4d1b-a6d8-8650e94895b9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] <== disconnect_volume: return (301ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:46:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:46:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'flavor' on Instance uuid 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:46:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-37d4b188-8a1e-4628-8bf1-e1b2645c1fa3 tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:46:45 user nova-compute[74788]: INFO nova.compute.claims [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Claim successful on node user
Nov 08 15:46:45 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:46:45 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:46:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.policy [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9655d103734d485691fe3d82e4e68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef632441d171499280801b367697b620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:46:46 user nova-compute[74788]: INFO nova.virt.block_device [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Booting with volume 1c112e88-393a-47a4-86d2-75cf7265cb12 at /dev/vda
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.utils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac6cab-efef-4e85-b7ae-dc1ad55a2871]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce8a042-d47c-4f66-a953-c11e4fecfb67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b091e-fbad-4bd8-b7fe-c66c05f47b59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfed5cc-d237-4e30-bfde-b4cb748f1db9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:46:46 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:46:46 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[edde6f41-9653-4bde-ac2f-b822ac8a0bfd]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG os_brick.utils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating existing volume attachment record: d0867cdc-83c8-468b-85a1-c9e3b0ff15c2 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:46:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Successfully created port: 0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Successfully updated port: 0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquired lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing instance network info cache due to event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] Acquiring lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Releasing lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Instance network_info: |[{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] Acquired lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:46:47 user nova-compute[74788]: DEBUG nova.network.neutron [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:46:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updated VIF entry in instance network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:46:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:46:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-e4c07d4d-db4a-46c0-8f1d-1c0d5de73788 req-046abe63-8c4a-417e-a69a-484f2a76e4bc service nova] Releasing lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:46:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:46:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:46:59 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:46:59 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [{"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-3a2d396e-1663-41c0-8437-3d8ed419d3de" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:47:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:02 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:03 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:47:04 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:47:04 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8390MB free_disk=25.10950469970703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:05 user nova-compute[74788]: INFO nova.compute.manager [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Terminating instance
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 3a2d396e-1663-41c0-8437-3d8ed419d3de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance dade6ce0-46fb-4340-bbec-50135625436f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 45c4d7c2-d6ab-4672-a26c-9630785928f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-unplugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-unplugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-5faa2c38-b4bb-4dc1-849f-ff772205472b req-ab6b8a25-b6c1-4869-af2d-b4910e125fd4 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-unplugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Instance destroyed successfully.
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lazy-loading 'resources' on Instance uuid 3a2d396e-1663-41c0-8437-3d8ed419d3de {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1242529938',display_name='tempest-AttachVolumeNegativeTest-server-1242529938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1242529938',id=44,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrSFYdNVwXIltls//Mzo3h96HmljEBPRVOu0ZhFX0FlkAhs9jzBkAVZF1qWNCnNUM7/92miNtTdD/rHuFAjAFjC5lJtVH3t9CqF6w4enKB93IhDZIvim06pwD/baVBWkw==',key_name='tempest-keypair-248219110',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:43:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e545713667df40d8b632db43b4f991b4',ramdisk_id='',reservation_id='r-r76qa5ma',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1449712443',owner_user_name='tempest-AttachVolumeNegativeTest-1449712443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e567adf9bfe49e58cc73195084c7acf',uuid=3a2d396e-1663-41c0-8437-3d8ed419d3de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converting VIF {"id": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "address": "fa:16:3e:f5:b2:e4", "network": {"id": "61535959-3c32-4066-8eaa-50af7c55395d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1399730763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e545713667df40d8b632db43b4f991b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c7cb69-c9", "ovs_interfaceid": "a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG os_vif [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1c7cb69-c9, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bcd1ad2-3ccc-4ccf-aca2-e99fcd52431f) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:05 user nova-compute[74788]: INFO os_vif [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:e4,bridge_name='br-int',has_traffic_filtering=True,id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01,network=Network(61535959-3c32-4066-8eaa-50af7c55395d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c7cb69-c9')
Nov 08 15:47:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Deleting instance files /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de_del
Nov 08 15:47:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Deletion of /opt/stack/data/nova/instances/3a2d396e-1663-41c0-8437-3d8ed419d3de_del complete
Nov 08 15:47:05 user nova-compute[74788]: INFO nova.compute.manager [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 15:47:05 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:47:05 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-6703fd68-2897-4924-a679-4b67b62d7676 req-908d53d2-626e-4763-b610-fd4792d38bf0 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-deleted-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:06 user nova-compute[74788]: INFO nova.compute.manager [req-6703fd68-2897-4924-a679-4b67b62d7676 req-908d53d2-626e-4763-b610-fd4792d38bf0 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Neutron deleted interface a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01; detaching it from the instance and deleting it from the info cache
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.network.neutron [req-6703fd68-2897-4924-a679-4b67b62d7676 req-908d53d2-626e-4763-b610-fd4792d38bf0 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:47:06 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Took 0.76 seconds to deallocate network for instance.
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-6703fd68-2897-4924-a679-4b67b62d7676 req-908d53d2-626e-4763-b610-fd4792d38bf0 service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Detach interface failed, port_id=a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01, reason: Instance 3a2d396e-1663-41c0-8437-3d8ed419d3de could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:47:06 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Deleted allocations for instance 3a2d396e-1663-41c0-8437-3d8ed419d3de
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8f3f45bb-5721-44f6-8282-2f8b13dbd13d tempest-AttachVolumeNegativeTest-1449712443 tempest-AttachVolumeNegativeTest-1449712443-project-member] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:07 user nova-compute[74788]: WARNING nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state deleted and task_state None.
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:07 user nova-compute[74788]: WARNING nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state deleted and task_state None.
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:07 user nova-compute[74788]: WARNING nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state deleted and task_state None.
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Acquiring lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] Lock "3a2d396e-1663-41c0-8437-3d8ed419d3de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] No waiting events found dispatching network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:07 user nova-compute[74788]: WARNING nova.compute.manager [req-9e477345-3349-4a36-b599-9aa37845e12d req-72fcb8b9-495d-4b85-98e8-08b75fc5c2ae service nova] [instance: 3a2d396e-1663-41c0-8437-3d8ed419d3de] Received unexpected event network-vif-plugged-a1c7cb69-c9ad-4eb7-aecc-7e3e8da83c01 for instance with vm_state deleted and task_state None.
Nov 08 15:47:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:47:09 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Creating image(s)
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Ensure instance console log exists: /opt/stack/data/nova/instances/45c4d7c2-d6ab-4672-a26c-9630785928f4/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Start _get_guest_xml network_info=[{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkNpcYlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45c4d7c2-d6ab-4672-a26c-9630785928f4', 'attached_at': '', 'detached_at': '', 'volume_id': '1c112e88-393a-47a4-86d2-75cf7265cb12', 'serial': '1c112e88-393a-47a4-86d2-75cf7265cb12'}, 'attachment_id': 'd0867cdc-83c8-468b-85a1-c9e3b0ff15c2', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:47:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:47:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkNpcYlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:47:09 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:47:09 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:47:09 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[272fd2a1-9d7c-4b4c-b832-97a899f977be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:47:09 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[118336e1-de47-465f-b953-91aa9f619314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12] added
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b251d23-e036-494a-bc79-840b48c949f9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03669fb-db45-4308-986f-96af1c1ac163]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkNpcYlD {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkNpcYlD" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9499ebaf-5d0f-4481-ae11-691170ea20bb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KkNpcYlD'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.106s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d9505-7c17-4e15-9637-68685cff75f9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.090s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c0b48-e95a-4a12-9f52-8cf8971e870b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd310201-187a-4bb0-a258-c2d186fdf41a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260]
Nov 08 15:47:09 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260] successful.
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e834f81e-4292-404f-a583-124c05a3516e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e193cd80-4774-4266-8da8-4d181f5e5b92]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:47:09 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740a20c-89e5-4130-9490-50a529ba754b]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkNpcYlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26130323638393336', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130323638393336', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1106841922',display_name='tempest-TestVolumeBootPattern-server-1106841922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1106841922',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-03b9q0eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:46:46Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=45c4d7c2-d6ab-4672-a26c-9630785928f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'pci_devices' on Instance uuid 45c4d7c2-d6ab-4672-a26c-9630785928f4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:47:10 user nova-compute[74788]:   <uuid>45c4d7c2-d6ab-4672-a26c-9630785928f4</uuid>
Nov 08 15:47:10 user nova-compute[74788]:   <name>instance-0000002f</name>
Nov 08 15:47:10 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:47:10 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:47:10 user nova-compute[74788]:   <metadata>
Nov 08 15:47:10 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:47:10 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:47:10 user nova-compute[74788]:       <nova:name>tempest-TestVolumeBootPattern-server-1106841922</nova:name>
Nov 08 15:47:10 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:47:09</nova:creationTime>
Nov 08 15:47:10 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:47:10 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:47:10 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:47:10 user nova-compute[74788]:       <nova:owner>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:user uuid="9655d103734d485691fe3d82e4e68032">tempest-TestVolumeBootPattern-1548248568-project-member</nova:user>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:project uuid="ef632441d171499280801b367697b620">tempest-TestVolumeBootPattern-1548248568</nova:project>
Nov 08 15:47:10 user nova-compute[74788]:       </nova:owner>
Nov 08 15:47:10 user nova-compute[74788]:       <nova:ports>
Nov 08 15:47:10 user nova-compute[74788]:         <nova:port uuid="0540a5e8-6a94-40d9-9a41-a290dd35c9ef">
Nov 08 15:47:10 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 15:47:10 user nova-compute[74788]:         </nova:port>
Nov 08 15:47:10 user nova-compute[74788]:       </nova:ports>
Nov 08 15:47:10 user nova-compute[74788]:     </nova:instance>
Nov 08 15:47:10 user nova-compute[74788]:   </metadata>
Nov 08 15:47:10 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:47:10 user nova-compute[74788]:     <system>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="serial">45c4d7c2-d6ab-4672-a26c-9630785928f4</entry>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="uuid">45c4d7c2-d6ab-4672-a26c-9630785928f4</entry>
Nov 08 15:47:10 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:47:10 user nova-compute[74788]:     </system>
Nov 08 15:47:10 user nova-compute[74788]:   </sysinfo>
Nov 08 15:47:10 user nova-compute[74788]:   <os>
Nov 08 15:47:10 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:47:10 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:47:10 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:47:10 user nova-compute[74788]:   </os>
Nov 08 15:47:10 user nova-compute[74788]:   <features>
Nov 08 15:47:10 user nova-compute[74788]:     <acpi/>
Nov 08 15:47:10 user nova-compute[74788]:     <apic/>
Nov 08 15:47:10 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:47:10 user nova-compute[74788]:   </features>
Nov 08 15:47:10 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:47:10 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:47:10 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:47:10 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:47:10 user nova-compute[74788]:   </clock>
Nov 08 15:47:10 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:47:10 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:47:10 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:47:10 user nova-compute[74788]:   </cpu>
Nov 08 15:47:10 user nova-compute[74788]:   <devices>
Nov 08 15:47:10 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:47:10 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:47:10 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:47:10 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:47:10 user nova-compute[74788]:       <serial>1c112e88-393a-47a4-86d2-75cf7265cb12</serial>
Nov 08 15:47:10 user nova-compute[74788]:     </disk>
Nov 08 15:47:10 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:47:10 user nova-compute[74788]:       <mac address="fa:16:3e:d5:95:06"/>
Nov 08 15:47:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:47:10 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:47:10 user nova-compute[74788]:       <target dev="tap0540a5e8-6a"/>
Nov 08 15:47:10 user nova-compute[74788]:     </interface>
Nov 08 15:47:10 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:47:10 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/45c4d7c2-d6ab-4672-a26c-9630785928f4/console.log" append="off"/>
Nov 08 15:47:10 user nova-compute[74788]:     </serial>
Nov 08 15:47:10 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:47:10 user nova-compute[74788]:     <video>
Nov 08 15:47:10 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:47:10 user nova-compute[74788]:     </video>
Nov 08 15:47:10 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:47:10 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:47:10 user nova-compute[74788]:     </rng>
Nov 08 15:47:10 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:47:10 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:47:10 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:47:10 user nova-compute[74788]:     </memballoon>
Nov 08 15:47:10 user nova-compute[74788]:   </devices>
Nov 08 15:47:10 user nova-compute[74788]: </domain>
Nov 08 15:47:10 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1106841922',display_name='tempest-TestVolumeBootPattern-server-1106841922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1106841922',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-03b9q0eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:46:46Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=45c4d7c2-d6ab-4672-a26c-9630785928f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG os_vif [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62298a66-2bbf-5da0-922b-e75c9549901f', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0540a5e8-6a, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0540a5e8-6a, col_values=(('qos', UUID('7d605596-bb32-49e1-8c23-641adc4346bc')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0540a5e8-6a, col_values=(('external_ids', {'iface-id': '0540a5e8-6a94-40d9-9a41-a290dd35c9ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:95:06', 'vm-uuid': '45c4d7c2-d6ab-4672-a26c-9630785928f4'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:10 user nova-compute[74788]: INFO os_vif [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a')
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:47:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] No VIF found with MAC fa:16:3e:d5:95:06, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] No waiting events found dispatching network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:12 user nova-compute[74788]: WARNING nova.compute.manager [req-8ad19ce8-6962-48c8-a920-8760e8af5337 req-babd8835-b925-4e77-bff7-5541b861c480 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received unexpected event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef for instance with vm_state building and task_state spawning.
Nov 08 15:47:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:47:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Instance spawned successfully.
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:47:14 user nova-compute[74788]: INFO nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] No waiting events found dispatching network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:14 user nova-compute[74788]: WARNING nova.compute.manager [req-996c138d-39de-47f8-b74b-dde1bbe3b80c req-f18d59de-953e-4c5a-a42b-aa4b2cf28a2e service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received unexpected event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef for instance with vm_state building and task_state spawning.
Nov 08 15:47:14 user nova-compute[74788]: INFO nova.compute.manager [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Took 28.77 seconds to build instance.
Nov 08 15:47:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d0edac71-68f4-4e2b-bc99-d714a9d93f65 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.875s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Verify base images {{(pid=74788) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74788) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Image id 04773e08-e579-43f8-a159-498093451850 yields fingerprint a66e0460467b456d73d643debf3dc17b009b5dc9 {{(pid=74788) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 15:47:24 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] image 04773e08-e579-43f8-a159-498093451850 at (/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9): checking
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] image 04773e08-e579-43f8-a159-498093451850 at (/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9): image is in use {{(pid=74788) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] 149d3800-34cd-479c-9f6c-626743b00fbe is a valid instance name {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] 149d3800-34cd-479c-9f6c-626743b00fbe has a disk file {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 15:47:24 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe is backed by a66e0460467b456d73d643debf3dc17b009b5dc9 {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] ebeaebbb-acd5-4f72-9b11-d81d85eca41f is a valid instance name {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e is a valid instance name {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] dade6ce0-46fb-4340-bbec-50135625436f is a valid instance name {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] dade6ce0-46fb-4340-bbec-50135625436f has a disk file {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance dade6ce0-46fb-4340-bbec-50135625436f is backed by a66e0460467b456d73d643debf3dc17b009b5dc9 {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] 45c4d7c2-d6ab-4672-a26c-9630785928f4 is a valid instance name {{(pid=74788) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b
Nov 08 15:47:25 user nova-compute[74788]: WARNING nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Active base files: /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Removable base files: /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3 /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56 /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2 /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6 /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618 /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fa454b1150bce0fe9638163c8b7ee2b1ead021a3
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c234acb601dd80fe8287b7a4da95abe1b5703f56
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57e809caa4fa4b05862dfacc888c3d428fd6def2
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8de221b7bbac3fb1f039a0f3dd35f479989463f6
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b26fa9bad603296fc54ec9a4e3c4d3b0b225618
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0f17dc79209f22605154a5440b711c3125b7d36b
Nov 08 15:47:25 user nova-compute[74788]: INFO nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cd1a38bf77e805779ae6e37b46e18d8cede49462
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Verification complete {{(pid=74788) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Verify swap images {{(pid=74788) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.imagecache [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Verify ephemeral images {{(pid=74788) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 15:47:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:47:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:29 user nova-compute[74788]: INFO nova.compute.manager [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Unrescuing
Nov 08 15:47:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:47:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:47:29 user nova-compute[74788]: DEBUG nova.network.neutron [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'flavor' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:30 user nova-compute[74788]: WARNING nova.compute.manager [req-03f1bb79-98a9-4d19-a060-7969524f1e15 req-23b5444e-a5b7-4d3f-8963-017bfa1cc4b9 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:47:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:31 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance destroyed successfully.
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:32 user nova-compute[74788]: WARNING nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:47:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:32 user nova-compute[74788]: WARNING nova.compute.manager [req-5e012f57-4cab-4d73-949e-e217f4869fbc req-4fdd4d3e-cdb0-4ad3-aeeb-82dde5f5815c service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:47:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-5a4f7fec-7ac6-498d-834e-1c46340cf0c1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:47:34 user nova-compute[74788]: WARNING nova.compute.manager [req-a19b0758-4b63-420c-ba1b-726918918b0b req-27c82642-69db-4e31-aa80-598314a17c57 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state None.
Nov 08 15:47:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-changed-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.compute.manager [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Refreshing instance network info cache due to event network-changed-502e1735-5caa-4b1d-9e39-69024ec321ff. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] Acquiring lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] Acquired lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Refreshing network info cache for port 502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:47:50 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Ignoring supplied device name: /dev/vdb
Nov 08 15:47:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updated VIF entry in instance network info cache for port 502e1735-5caa-4b1d-9e39-69024ec321ff. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG nova.network.neutron [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updating instance_info_cache with network_info: [{"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c8e29a86-5ae5-434c-8f8d-40b680e3a073 req-c383fd2b-314b-4017-9c26-6ad94dc37e72 service nova] Releasing lock "refresh_cache-dade6ce0-46fb-4340-bbec-50135625436f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:47:50 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:47:50 user nova-compute[74788]: INFO nova.compute.manager [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Attaching volume c7268990-27e6-4247-90c2-11ab3300f8ff to /dev/vdb
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.utils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef69b5-3206-4edd-8c86-ec805e1b1403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b08a3f-c107-4c6b-916b-06b01afef9b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e74b37-803f-4b49-9809-da8c064addf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b327e-7efa-408b-9197-a34c7484e548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:47:51 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:47:51 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee63f230-1deb-459f-8c60-b87e018b8765]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG os_brick.utils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:47:51 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updating existing volume attachment record: 9f566aed-fca0-4066-8cf8-12e083259407 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:47:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:47:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:47:55 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:47:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:01 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:48:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:03 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:04 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:48:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:48:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.136188507080078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance dade6ce0-46fb-4340-bbec-50135625436f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 45c4d7c2-d6ab-4672-a26c-9630785928f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:48:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 45c4d7c2-d6ab-4672-a26c-9630785928f4 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:48:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:48:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:10 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:48:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwzOYCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:48:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:48:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:48:14 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c611bf7-d6e2-415f-9087-87bc830bb964]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:48:14 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3623f0e-2f97-4b84-8ce8-14ad8c71f860]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff] added
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555772c-7f9f-438b-bf80-c144949a23a4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[62220fa9-c41a-478c-b709-deaf5ecfa354]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlwzOYCL {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlwzOYCL" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523963d-4faf-45af-a502-223d9877eb8e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlwzOYCL'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f6f2b-bc82-4338-ad2d-855327e790a8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[832449d5-d0bf-4df4-8e60-ab0cac391eb0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730a8e4-35db-47ca-af43-d2f0b971bb4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260]
Nov 08 15:48:14 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260] successful.
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bd5b6-dcc5-4adf-a347-b71d204bf8e9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfeebfe-1b69-4c94-b69e-c5d1a4503462]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:14 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:48:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e86028-2e22-4913-a5aa-e6074bb39da2]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:48:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwzOYCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26437316637613437', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437316637613437', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:48:15 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:48:15 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:48:15 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:48:15 user nova-compute[74788]:   <serial>c7268990-27e6-4247-90c2-11ab3300f8ff</serial>
Nov 08 15:48:15 user nova-compute[74788]: </disk>
Nov 08 15:48:15 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:48:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] No VIF found with MAC fa:16:3e:31:8d:17, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:48:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f18b8db3-bacc-4749-a6ed-d6c43693b0c1 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.013s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.956s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:48:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing instance network info cache due to event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] Acquiring lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] Acquired lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updated VIF entry in instance network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-28751f02-0fc3-4769-8995-a40cdbc906d6 req-f5afd941-a0cf-4bed-824e-5ac0bcc03c17 service nova] Releasing lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing instance network info cache due to event network-changed-0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] Acquiring lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] Acquired lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.network.neutron [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Refreshing network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:38 user nova-compute[74788]: INFO nova.compute.manager [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Terminating instance
Nov 08 15:48:38 user nova-compute[74788]: DEBUG nova.compute.manager [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-unplugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] No waiting events found dispatching network-vif-unplugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-73155ae4-bb75-41d1-a80f-70276aa5977b req-9788c79d-d465-4e13-b7d9-2f92f4167583 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-unplugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updated VIF entry in instance network info cache for port 0540a5e8-6a94-40d9-9a41-a290dd35c9ef. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [{"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fea48d51-261c-4b88-afeb-4913bce97ba6 req-e2af1660-eb45-4dec-97e2-cdfb8c6d3248 service nova] Releasing lock "refresh_cache-45c4d7c2-d6ab-4672-a26c-9630785928f4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:48:39 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Instance destroyed successfully.
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.objects.instance [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'resources' on Instance uuid 45c4d7c2-d6ab-4672-a26c-9630785928f4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1106841922',display_name='tempest-TestVolumeBootPattern-server-1106841922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1106841922',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-03b9q0eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:47:14Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=45c4d7c2-d6ab-4672-a26c-9630785928f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "address": "fa:16:3e:d5:95:06", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0540a5e8-6a", "ovs_interfaceid": "0540a5e8-6a94-40d9-9a41-a290dd35c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_vif [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0540a5e8-6a, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d605596-bb32-49e1-8c23-641adc4346bc) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:39 user nova-compute[74788]: INFO os_vif [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:95:06,bridge_name='br-int',has_traffic_filtering=True,id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0540a5e8-6a')
Nov 08 15:48:39 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkNpcYlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:48:39 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b3cbab-bc7a-4f54-b749-bef0e4d64d72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:48:39 user nova-compute[74788]: No targets found.
Nov 08 15:48:39 user nova-compute[74788]: iSNS:
Nov 08 15:48:39 user nova-compute[74788]: No targets found.
Nov 08 15:48:39 user nova-compute[74788]: STATIC:
Nov 08 15:48:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:48:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:48:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:48:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12
Nov 08 15:48:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:48:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:48:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff
Nov 08 15:48:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:48:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:48:39 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:48:39 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:48:39 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:48:39 user nova-compute[74788]: FIRMWARE:
Nov 08 15:48:39 user nova-compute[74788]: No targets found.
Nov 08 15:48:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:48:39 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:48:39 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73c26d-cdcd-45ee-8ccb-0d8728e2bb1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69c121-4a75-49b5-9a36-0686021842a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:48:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 (non-flash)
Nov 08 15:48:39 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:48:39 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758469000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[64165a52-c689-4619-9239-60dbafab47ba]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b8edde-2a12-4ff9-9609-b8feecadc5fa]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd6bb73-291f-4e59-b515-be4826b07236]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f8d56-722c-4015-af73-b3a894d36673]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO82a14ffe-a026893640b88906', '/dev/disk/by-id/scsi-26130323638393336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_82a14ffe') {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed75a1e-a745-4c4b-90e6-5dbb49d7c0fe]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd7f24-c48c-4f65-9628-3b5254754235]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:39 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d160c-ccde-4e7f-9c97-fbae133157e6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260]
Nov 08 15:48:40 user nova-compute[74788]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12, portal: 172.16.0.220,3260] successful.
Nov 08 15:48:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c112e88-393a-47a4-86d2-75cf7265cb12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f9c12-2b08-4508-9683-9a49529c5db8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== disconnect_volume: return (334ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:48:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Deleting instance files /opt/stack/data/nova/instances/45c4d7c2-d6ab-4672-a26c-9630785928f4_del
Nov 08 15:48:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Deletion of /opt/stack/data/nova/instances/45c4d7c2-d6ab-4672-a26c-9630785928f4_del complete
Nov 08 15:48:40 user nova-compute[74788]: INFO nova.compute.manager [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 15:48:40 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:48:40 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:48:41 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Took 0.88 seconds to deallocate network for instance.
Nov 08 15:48:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-63dcb9dc-1ff4-4535-9bb0-43722b770209 req-e3c15b92-a91e-4b93-a896-7bccc237a086 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-deleted-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:48:41 user nova-compute[74788]: INFO nova.compute.manager [req-63dcb9dc-1ff4-4535-9bb0-43722b770209 req-e3c15b92-a91e-4b93-a896-7bccc237a086 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Neutron deleted interface 0540a5e8-6a94-40d9-9a41-a290dd35c9ef; detaching it from the instance and deleting it from the info cache
Nov 08 15:48:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-63dcb9dc-1ff4-4535-9bb0-43722b770209 req-e3c15b92-a91e-4b93-a896-7bccc237a086 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-63dcb9dc-1ff4-4535-9bb0-43722b770209 req-e3c15b92-a91e-4b93-a896-7bccc237a086 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Detach interface failed, port_id=0540a5e8-6a94-40d9-9a41-a290dd35c9ef, reason: Instance 45c4d7c2-d6ab-4672-a26c-9630785928f4 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] Acquiring lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] No waiting events found dispatching network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:48:41 user nova-compute[74788]: WARNING nova.compute.manager [req-5d8b6a36-a4d9-43e3-b907-84fcdbf78671 req-350e8805-70eb-4345-a545-d3ebae205715 service nova] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Received unexpected event network-vif-plugged-0540a5e8-6a94-40d9-9a41-a290dd35c9ef for instance with vm_state active and task_state deleting.
Nov 08 15:48:42 user nova-compute[74788]: INFO nova.compute.manager [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 45c4d7c2-d6ab-4672-a26c-9630785928f4] Took 1.07 seconds to detach 1 volumes for instance.
Nov 08 15:48:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:48:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:48:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:48:42 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:48:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:42 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance 45c4d7c2-d6ab-4672-a26c-9630785928f4
Nov 08 15:48:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-d18770db-0371-433a-be04-7f15580fcb12 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "45c4d7c2-d6ab-4672-a26c-9630785928f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.617s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:48:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:48:57 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:48:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:49:02 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:49:03 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:49:03 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:49:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:49:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:05 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:49:07 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:49:07 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.133380889892578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance dade6ce0-46fb-4340-bbec-50135625436f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:49:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:14 user nova-compute[74788]: INFO nova.compute.manager [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Detaching volume c7268990-27e6-4247-90c2-11ab3300f8ff
Nov 08 15:49:14 user nova-compute[74788]: INFO nova.virt.block_device [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Attempting to driver detach volume c7268990-27e6-4247-90c2-11ab3300f8ff from mountpoint /dev/vdb
Nov 08 15:49:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Attempting to detach device vdb from instance dade6ce0-46fb-4340-bbec-50135625436f from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:49:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:49:14 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:49:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:49:14 user nova-compute[74788]:   <serial>c7268990-27e6-4247-90c2-11ab3300f8ff</serial>
Nov 08 15:49:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:49:14 user nova-compute[74788]: </disk>
Nov 08 15:49:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:49:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully detached device vdb from instance dade6ce0-46fb-4340-bbec-50135625436f from the persistent domain config.
Nov 08 15:49:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dade6ce0-46fb-4340-bbec-50135625436f from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:49:14 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:49:14 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:49:14 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:49:14 user nova-compute[74788]:   <serial>c7268990-27e6-4247-90c2-11ab3300f8ff</serial>
Nov 08 15:49:14 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:49:14 user nova-compute[74788]: </disk>
Nov 08 15:49:14 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:49:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:49:21 user nova-compute[74788]: INFO nova.compute.claims [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Claim successful on node user
Nov 08 15:49:21 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:49:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:49:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.policy [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8015e2645eac4fefb444c80dd1922ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6442811e582464cb1edd2a82d930bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:49:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Creating image(s)
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk 1073741824" returned: 0 in 0.052s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Successfully created port: a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:49:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Cannot resize image /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Successfully updated port: a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-changed-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Refreshing instance network info cache due to event network-changed-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] Acquiring lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updating instance_info_cache with network_info: [{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Instance network_info: |[{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] Acquired lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Refreshing network info cache for port a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Start _get_guest_xml network_info=[{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:49:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:49:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874417440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874417440',id=48,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ixp20n0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:49:22Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=8cd25306-3d05-41d6-90f8-b537cc59a94c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd25306-3d05-41d6-90f8-b537cc59a94c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:49:23 user nova-compute[74788]:   <uuid>8cd25306-3d05-41d6-90f8-b537cc59a94c</uuid>
Nov 08 15:49:23 user nova-compute[74788]:   <name>instance-00000030</name>
Nov 08 15:49:23 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:49:23 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:49:23 user nova-compute[74788]:   <metadata>
Nov 08 15:49:23 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:49:23 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-874417440</nova:name>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:49:23</nova:creationTime>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:49:23 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:49:23 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:owner>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:49:23 user nova-compute[74788]:       </nova:owner>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:49:23 user nova-compute[74788]:       <nova:ports>
Nov 08 15:49:23 user nova-compute[74788]:         <nova:port uuid="a53c5dd7-4ad6-48d1-99c7-a9cb869f578b">
Nov 08 15:49:23 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 15:49:23 user nova-compute[74788]:         </nova:port>
Nov 08 15:49:23 user nova-compute[74788]:       </nova:ports>
Nov 08 15:49:23 user nova-compute[74788]:     </nova:instance>
Nov 08 15:49:23 user nova-compute[74788]:   </metadata>
Nov 08 15:49:23 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:49:23 user nova-compute[74788]:     <system>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="serial">8cd25306-3d05-41d6-90f8-b537cc59a94c</entry>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="uuid">8cd25306-3d05-41d6-90f8-b537cc59a94c</entry>
Nov 08 15:49:23 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:49:23 user nova-compute[74788]:     </system>
Nov 08 15:49:23 user nova-compute[74788]:   </sysinfo>
Nov 08 15:49:23 user nova-compute[74788]:   <os>
Nov 08 15:49:23 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:49:23 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:49:23 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:49:23 user nova-compute[74788]:   </os>
Nov 08 15:49:23 user nova-compute[74788]:   <features>
Nov 08 15:49:23 user nova-compute[74788]:     <acpi/>
Nov 08 15:49:23 user nova-compute[74788]:     <apic/>
Nov 08 15:49:23 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:49:23 user nova-compute[74788]:   </features>
Nov 08 15:49:23 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:49:23 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:49:23 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:49:23 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:49:23 user nova-compute[74788]:   </clock>
Nov 08 15:49:23 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:49:23 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:49:23 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:49:23 user nova-compute[74788]:   </cpu>
Nov 08 15:49:23 user nova-compute[74788]:   <devices>
Nov 08 15:49:23 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:49:23 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:49:23 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk"/>
Nov 08 15:49:23 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:49:23 user nova-compute[74788]:     </disk>
Nov 08 15:49:23 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:49:23 user nova-compute[74788]:       <mac address="fa:16:3e:7c:a1:9a"/>
Nov 08 15:49:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:49:23 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:49:23 user nova-compute[74788]:       <target dev="tapa53c5dd7-4a"/>
Nov 08 15:49:23 user nova-compute[74788]:     </interface>
Nov 08 15:49:23 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:49:23 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/console.log" append="off"/>
Nov 08 15:49:23 user nova-compute[74788]:     </serial>
Nov 08 15:49:23 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:49:23 user nova-compute[74788]:     <video>
Nov 08 15:49:23 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:49:23 user nova-compute[74788]:     </video>
Nov 08 15:49:23 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:49:23 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:49:23 user nova-compute[74788]:     </rng>
Nov 08 15:49:23 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:49:23 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:49:23 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:49:23 user nova-compute[74788]:     </memballoon>
Nov 08 15:49:23 user nova-compute[74788]:   </devices>
Nov 08 15:49:23 user nova-compute[74788]: </domain>
Nov 08 15:49:23 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874417440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874417440',id=48,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ixp20n0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:49:22Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=8cd25306-3d05-41d6-90f8-b537cc59a94c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG os_vif [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4acf72c4-6ab3-588d-bb69-4519beabdc8d', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53c5dd7-4a, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53c5dd7-4a, col_values=(('qos', UUID('87b1f994-360d-41f6-a026-c1e6878a6b25')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53c5dd7-4a, col_values=(('external_ids', {'iface-id': 'a53c5dd7-4ad6-48d1-99c7-a9cb869f578b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a1:9a', 'vm-uuid': '8cd25306-3d05-41d6-90f8-b537cc59a94c'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:23 user nova-compute[74788]: INFO os_vif [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a')
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:49:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:7c:a1:9a, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:49:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updated VIF entry in instance network info cache for port a53c5dd7-4ad6-48d1-99c7-a9cb869f578b. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:49:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updating instance_info_cache with network_info: [{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-913c76b9-5d18-426c-aeaf-3a93b7a1ae90 req-66c59efd-550a-4f03-9224-6d8475d08b5b service nova] Releasing lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] No waiting events found dispatching network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:25 user nova-compute[74788]: WARNING nova.compute.manager [req-6e5b52eb-5926-4e3d-a7fc-283cb1a56841 req-3059b2ad-7275-4617-b456-d4b7f905fe30 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received unexpected event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b for instance with vm_state building and task_state spawning.
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:49:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Instance spawned successfully.
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:49:27 user nova-compute[74788]: INFO nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:49:27 user nova-compute[74788]: INFO nova.compute.manager [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Took 5.88 seconds to build instance.
Nov 08 15:49:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c1169e4b-4a35-45fd-bc49-a01951f4eaaf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.987s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] No waiting events found dispatching network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:27 user nova-compute[74788]: WARNING nova.compute.manager [req-6b7620fd-ee96-4b9b-b913-10bb8d39c93f req-c958e202-ee75-4f29-9942-fb93dd9df0d6 service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received unexpected event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b for instance with vm_state active and task_state None.
Nov 08 15:49:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:35 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dade6ce0-46fb-4340-bbec-50135625436f is timed out.
Nov 08 15:49:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully detached device vdb from instance dade6ce0-46fb-4340-bbec-50135625436f from the live domain config.
Nov 08 15:49:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwzOYCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:49:35 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[71501af0-9d7b-491d-8d4d-991c73b758e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:49:35 user nova-compute[74788]: No targets found.
Nov 08 15:49:35 user nova-compute[74788]: iSNS:
Nov 08 15:49:35 user nova-compute[74788]: No targets found.
Nov 08 15:49:35 user nova-compute[74788]: STATIC:
Nov 08 15:49:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:49:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff
Nov 08 15:49:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:35 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:49:35 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:35 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:35 user nova-compute[74788]: FIRMWARE:
Nov 08 15:49:35 user nova-compute[74788]: No targets found.
Nov 08 15:49:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:49:35 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:49:35 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e34d95-28c4-46b8-bc4a-f168e334f1a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e407024e-981b-455d-a17e-a0755bd0725a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:35 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:35 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:49:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:35 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:35 user nova-compute[74788]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff (non-flash)
Nov 08 15:49:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77584e5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[469e84fc-3a87-460a-a856-7ba271955eec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fcb341-bbce-4588-8c3d-4f883f540347]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f107a1-3778-4df5-ae2d-94392c11bacb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd19ebc-1cd2-4c60-be39-146a0b1b0e21]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f2ee47-cb2c-48f1-9786-25110cf6030d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[324765a8-51af-4dac-b099-61b2bd26a0cc]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260]
Nov 08 15:49:35 user nova-compute[74788]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff, portal: 172.16.0.220,3260] successful.
Nov 08 15:49:35 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a81518d-2a33-4e05-93ed-2da59832f073]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== disconnect_volume: return (329ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:49:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG nova.objects.instance [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'flavor' on Instance uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3d086626-d41c-45ac-88de-71b00ff0075f tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.905s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.777s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:36 user nova-compute[74788]: INFO nova.compute.manager [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Terminating instance
Nov 08 15:49:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-unplugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] No waiting events found dispatching network-vif-unplugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-cba4ba3d-70ea-468b-ac7d-d396f4f589d8 req-0344c231-01ae-4f12-876d-b8853020ec34 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-unplugged-502e1735-5caa-4b1d-9e39-69024ec321ff for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:49:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Instance destroyed successfully.
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lazy-loading 'resources' on Instance uuid dade6ce0-46fb-4340-bbec-50135625436f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:45:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1257982106',display_name='tempest-VolumesSnapshotTestJSON-instance-1257982106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1257982106',id=46,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI9Xi8XkVFkNoMOHvWT+PTLNOfWd/XoSwFhe4FxKwMFOwFRcLYSExZtHrMubi/Q3UWo84oYa+D7qwK/0ko7aXnOhZiJVzKy+yVsxYB9BzFvmsyVUXmXjg7lERmLMr3Dzg==',key_name='tempest-keypair-1252390224',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:46:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b242b447c4d4e49abf8d4df70317aad',ramdisk_id='',reservation_id='r-g0j3srsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1290769345',owner_user_name='tempest-VolumesSnapshotTestJSON-1290769345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fe699714bde4a5f9a726d0d43695be2',uuid=dade6ce0-46fb-4340-bbec-50135625436f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converting VIF {"id": "502e1735-5caa-4b1d-9e39-69024ec321ff", "address": "fa:16:3e:31:8d:17", "network": {"id": "fb43f316-c8bd-4d0f-a17f-5920d8ccc261", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-69753630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b242b447c4d4e49abf8d4df70317aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e1735-5c", "ovs_interfaceid": "502e1735-5caa-4b1d-9e39-69024ec321ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_vif [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap502e1735-5c, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5eb2353-7cb1-40fe-b8ea-f02a49915665) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:37 user nova-compute[74788]: INFO os_vif [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:8d:17,bridge_name='br-int',has_traffic_filtering=True,id=502e1735-5caa-4b1d-9e39-69024ec321ff,network=Network(fb43f316-c8bd-4d0f-a17f-5920d8ccc261),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e1735-5c')
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlwzOYCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:49:37 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cda7863-36c5-4379-9476-5595fc0ecb7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:49:37 user nova-compute[74788]: No targets found.
Nov 08 15:49:37 user nova-compute[74788]: iSNS:
Nov 08 15:49:37 user nova-compute[74788]: No targets found.
Nov 08 15:49:37 user nova-compute[74788]: STATIC:
Nov 08 15:49:37 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:49:37 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:37 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:37 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:49:37 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:37 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:37 user nova-compute[74788]: FIRMWARE:
Nov 08 15:49:37 user nova-compute[74788]: No targets found.
Nov 08 15:49:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:49:37 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:49:37 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7268990-27e6-4247-90c2-11ab3300f8ff', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d8b508-5e94-4729-a67b-7e5c085cf3c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[36033906-5184-42cf-b045-3e27c8534e77]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:37 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:37 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:37 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d13f0>, {}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Disconnecting from: [] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] <== disconnect_volume: return (73ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:49:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Deleting instance files /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f_del
Nov 08 15:49:37 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Deletion of /opt/stack/data/nova/instances/dade6ce0-46fb-4340-bbec-50135625436f_del complete
Nov 08 15:49:37 user nova-compute[74788]: INFO nova.compute.manager [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 15:49:37 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:49:37 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:38 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Took 0.85 seconds to deallocate network for instance.
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-2beea66f-a7c7-4d2e-b672-4fb79be743cc req-b0957e83-d6f6-457a-9683-92c70e437380 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-deleted-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:38 user nova-compute[74788]: WARNING nova.volume.cinder [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Attachment 9f566aed-fca0-4066-8cf8-12e083259407 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9f566aed-fca0-4066-8cf8-12e083259407. (HTTP 404) (Request-ID: req-c29a6bd4-ab93-4994-a64a-6d25604671be)
Nov 08 15:49:38 user nova-compute[74788]: INFO nova.compute.manager [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:38 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Deleted allocations for instance dade6ce0-46fb-4340-bbec-50135625436f
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5dc763d0-5efa-45f5-a1cc-dc3e8f9172f6 tempest-VolumesSnapshotTestJSON-1290769345 tempest-VolumesSnapshotTestJSON-1290769345-project-member] Lock "dade6ce0-46fb-4340-bbec-50135625436f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] Acquiring lock "dade6ce0-46fb-4340-bbec-50135625436f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] Lock "dade6ce0-46fb-4340-bbec-50135625436f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:38 user nova-compute[74788]: DEBUG nova.compute.manager [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] No waiting events found dispatching network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:38 user nova-compute[74788]: WARNING nova.compute.manager [req-99018456-512e-4a95-96aa-7e377a5b3822 req-14dea471-9ebc-4402-a110-ec6ceeb7f1e4 service nova] [instance: dade6ce0-46fb-4340-bbec-50135625436f] Received unexpected event network-vif-plugged-502e1735-5caa-4b1d-9e39-69024ec321ff for instance with vm_state deleted and task_state None.
Nov 08 15:49:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing instance network info cache due to event network-changed-59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] Acquiring lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] Acquired lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Refreshing network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:53 user nova-compute[74788]: INFO nova.compute.manager [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Terminating instance
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updated VIF entry in instance network info cache for port 59e24d42-8693-4a57-8d60-ff365af5ccb2. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG nova.network.neutron [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [{"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a6f3d4d8-6343-4ba4-ab59-ef383aad079f req-1419aa64-b6e3-47ef-973a-e00aa177a050 service nova] Releasing lock "refresh_cache-7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:49:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Instance destroyed successfully.
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lazy-loading 'resources' on Instance uuid 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-148101586',display_name='tempest-TestVolumeBootPattern-server-148101586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-148101586',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikRorxlsdY2fmtGG1fPYdVGsp3QzWxlogeGs+q2bodUTxUwoWVy5E1HbecqflSCAqhQ3gBkKrJxp0Xc8T1TeRLb6vqykEL0Fo9VYrNbYGwo5FwTWEq5ulzlG0hcnQ5kA==',key_name='tempest-TestVolumeBootPattern-1507997071',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef632441d171499280801b367697b620',ramdisk_id='',reservation_id='r-00w0ly7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1548248568',owner_user_name='tempest-TestVolumeBootPattern-1548248568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:44:29Z,user_data=None,user_id='9655d103734d485691fe3d82e4e68032',uuid=7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converting VIF {"id": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "address": "fa:16:3e:ca:e1:3c", "network": {"id": "77872700-06e6-423f-b7fc-317862b6b9b7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-23034122-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef632441d171499280801b367697b620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59e24d42-86", "ovs_interfaceid": "59e24d42-8693-4a57-8d60-ff365af5ccb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_vif [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59e24d42-86, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00b831f3-44a8-4f91-ac89-3a3019d1667a) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:54 user nova-compute[74788]: INFO os_vif [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e1:3c,bridge_name='br-int',has_traffic_filtering=True,id=59e24d42-8693-4a57-8d60-ff365af5ccb2,network=Network(77872700-06e6-423f-b7fc-317862b6b9b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59e24d42-86')
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHNgfYpU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:49:54 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c052a75-e256-440f-aa0a-7f8237455a63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:49:54 user nova-compute[74788]: No targets found.
Nov 08 15:49:54 user nova-compute[74788]: iSNS:
Nov 08 15:49:54 user nova-compute[74788]: No targets found.
Nov 08 15:49:54 user nova-compute[74788]: STATIC:
Nov 08 15:49:54 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:49:54 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:54 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:54 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e
Nov 08 15:49:54 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:49:54 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:49:54 user nova-compute[74788]: FIRMWARE:
Nov 08 15:49:54 user nova-compute[74788]: No targets found.
Nov 08 15:49:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:49:54 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:49:54 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a0d545-fe09-41bb-8e4e-5ab6bde1b415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac68d6e-d6bf-4928-9965-73cc052f004a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:54 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e (non-flash)
Nov 08 15:49:54 user nova-compute[74788]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:49:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758468d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d69f7d-f805-4055-adf3-5c326b9ab609]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.051s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f574a9-b63e-4c7e-82dd-392c75c9eb77]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7161d02b-1d02-48a9-9f7c-bf9e11f368c8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc2528-a23b-4d80-93aa-33933202ace7]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26565346563633838', '/dev/disk/by-id/scsi-1SCST_BIO23278a79-ee4ecc88d0033ebf', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_23278a79') {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e28d2-28d8-4d0e-a550-8d23ca608937]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2fd168-4b4b-4392-9e71-1802d3d1d78e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[66399b2c-dfd1-492a-a476-fbe4d9ea2a36]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260]
Nov 08 15:49:54 user nova-compute[74788]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e, portal: 172.16.0.220,3260] successful.
Nov 08 15:49:54 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a80a43-2323-40d5-9612-d557ee1fff8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e478b8e-b00b-4777-86d4-edffc6cbfeb0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] <== disconnect_volume: return (402ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:49:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Deleting instance files /opt/stack/data/nova/instances/7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e_del
Nov 08 15:49:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Deletion of /opt/stack/data/nova/instances/7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e_del complete
Nov 08 15:49:54 user nova-compute[74788]: INFO nova.compute.manager [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 15:49:54 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:49:54 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:49:55 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Took 0.54 seconds to deallocate network for instance.
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-unplugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] No waiting events found dispatching network-vif-unplugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-unplugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Acquiring lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] No waiting events found dispatching network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:49:55 user nova-compute[74788]: WARNING nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received unexpected event network-vif-plugged-59e24d42-8693-4a57-8d60-ff365af5ccb2 for instance with vm_state active and task_state deleting.
Nov 08 15:49:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-d8b9fd3d-3b6d-4abc-8dbb-b67b9888bb1c req-b965c132-051c-4685-8013-66e1c901d986 service nova] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Received event network-vif-deleted-59e24d42-8693-4a57-8d60-ff365af5ccb2 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:49:56 user nova-compute[74788]: INFO nova.compute.manager [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] [instance: 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e] Took 0.90 seconds to detach 1 volumes for instance.
Nov 08 15:49:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:49:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:49:56 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:49:56 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:49:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:56 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Deleted allocations for instance 7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e
Nov 08 15:49:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c9b97928-4f01-4dfe-806b-d01c6428f892 tempest-TestVolumeBootPattern-1548248568 tempest-TestVolumeBootPattern-1548248568-project-member] Lock "7e96b0c8-e359-4319-b1ac-d2dfd0cc3a1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:49:57 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:49:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:49:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:50:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:50:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:50:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:50:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:50:06 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:50:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:50:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:50:08 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.122211456298828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:50:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:50:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:50:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:50:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:50:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:50:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:50:59 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:03 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:51:05 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:51:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:51:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.119739532470703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:51:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:51:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:51:13 user nova-compute[74788]: INFO nova.compute.manager [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] instance snapshotting
Nov 08 15:51:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Beginning live snapshot process
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.221s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906.delta 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906.delta 1073741824" returned: 0 in 0.050s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 15:51:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:51:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:51:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 15:51:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 15:51:15 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:51:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906.delta /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:51:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906.delta /opt/stack/data/nova/instances/snapshots/tmp2lu_anxe/24f1f94d6a734d938d936b408eed1906" returned: 0 in 0.428s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:51:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Snapshot extracted, beginning image upload
Nov 08 15:51:18 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Snapshot image upload complete
Nov 08 15:51:18 user nova-compute[74788]: INFO nova.compute.manager [None req-c6aa6344-21a3-47b4-bcef-c4a50ddf72a5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Took 5.30 seconds to snapshot the instance on the hypervisor.
Nov 08 15:51:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:51:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:51:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:51:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:51:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:51:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:51:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:52:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:52:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:07 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:52:09 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.068645477294922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:52:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:52:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:52:21 user nova-compute[74788]: INFO nova.compute.claims [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Claim successful on node user
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:52:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:52:21 user nova-compute[74788]: DEBUG nova.policy [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8015e2645eac4fefb444c80dd1922ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6442811e582464cb1edd2a82d930bac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:52:21 user nova-compute[74788]: INFO nova.virt.block_device [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Booting with volume-backed-image 04773e08-e579-43f8-a159-498093451850 at /dev/vda
Nov 08 15:52:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Successfully created port: 7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Successfully updated port: 7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-changed-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Refreshing instance network info cache due to event network-changed-7f68dd32-fce9-4fcb-836e-b6dae2626762. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] Acquiring lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance network_info: |[{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] Acquired lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Refreshing network info cache for port 7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updated VIF entry in instance network info cache for port 7f68dd32-fce9-4fcb-836e-b6dae2626762. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:52:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:52:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c9249ad4-2a89-4f96-8bd2-07edb5d07eca req-07d9de19-4dcd-4141-87c8-56286403c0cb service nova] Releasing lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:52:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.utils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33893d3-607c-4201-89a4-877ed848bdd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbadddb-3565-4cb8-8dc5-300f6ccd44b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e442df-5529-451c-a738-4f013831eb6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eda3c2-75cf-4835-925f-09e25a4b217c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:52:42 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:52:42 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa16a0-87d8-43fa-8e67-0942fa97f289]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG os_brick.utils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:52:42 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating existing volume attachment record: 8dda88c5-a955-46e3-b7d8-28333696a393 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:52:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:45 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:52:45 user nova-compute[74788]: INFO nova.compute.claims [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Claim successful on node user
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:52:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.policy [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd618fd4a25eb4fbc8ca846939c2745b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f471aa860a48c1be9521823c6e2c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:52:46 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Creating image(s)
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "/opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "/opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk 1073741824" returned: 0 in 0.050s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:46 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Successfully created port: 51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Cannot resize image /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Successfully updated port: 51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-changed-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.compute.manager [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Refreshing instance network info cache due to event network-changed-51589533-181b-4af7-a188-5780843f2a66. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:52:47 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.neutron [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Instance network_info: |[{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Refreshing network info cache for port 51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Start _get_guest_xml network_info=[{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:52:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:52:48 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266898929',display_name='tempest-SnapshotDataIntegrityTests-server-266898929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266898929',id=50,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNxg2/14LhD8CA+yAs64juG3u+dnQxGpTeiOsbKNZYZg6OR3HRpt0n6xwGRQx8ZConYKht1gqpVam9nhrULkimEJ2uowPChgggBJcT+p1VePQT787VpBvsC8hKzcUSZg==',key_name='tempest-keypair-248206686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38f471aa860a48c1be9521823c6e2c0d',ramdisk_id='',reservation_id='r-9dd4r8h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1540293599',owner_user_name='tempest-SnapshotDataIntegrityTests-1540293599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d618fd4a25eb4fbc8ca846939c2745b3',uuid=ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converting VIF {"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.objects.instance [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'pci_devices' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:52:48 user nova-compute[74788]:   <uuid>ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0</uuid>
Nov 08 15:52:48 user nova-compute[74788]:   <name>instance-00000032</name>
Nov 08 15:52:48 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:52:48 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:52:48 user nova-compute[74788]:   <metadata>
Nov 08 15:52:48 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:52:48 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-266898929</nova:name>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:52:48</nova:creationTime>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:52:48 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:52:48 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:owner>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:user uuid="d618fd4a25eb4fbc8ca846939c2745b3">tempest-SnapshotDataIntegrityTests-1540293599-project-member</nova:user>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:project uuid="38f471aa860a48c1be9521823c6e2c0d">tempest-SnapshotDataIntegrityTests-1540293599</nova:project>
Nov 08 15:52:48 user nova-compute[74788]:       </nova:owner>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:52:48 user nova-compute[74788]:       <nova:ports>
Nov 08 15:52:48 user nova-compute[74788]:         <nova:port uuid="51589533-181b-4af7-a188-5780843f2a66">
Nov 08 15:52:48 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:52:48 user nova-compute[74788]:         </nova:port>
Nov 08 15:52:48 user nova-compute[74788]:       </nova:ports>
Nov 08 15:52:48 user nova-compute[74788]:     </nova:instance>
Nov 08 15:52:48 user nova-compute[74788]:   </metadata>
Nov 08 15:52:48 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:52:48 user nova-compute[74788]:     <system>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="serial">ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0</entry>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="uuid">ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0</entry>
Nov 08 15:52:48 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:52:48 user nova-compute[74788]:     </system>
Nov 08 15:52:48 user nova-compute[74788]:   </sysinfo>
Nov 08 15:52:48 user nova-compute[74788]:   <os>
Nov 08 15:52:48 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:52:48 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:52:48 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:52:48 user nova-compute[74788]:   </os>
Nov 08 15:52:48 user nova-compute[74788]:   <features>
Nov 08 15:52:48 user nova-compute[74788]:     <acpi/>
Nov 08 15:52:48 user nova-compute[74788]:     <apic/>
Nov 08 15:52:48 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:52:48 user nova-compute[74788]:   </features>
Nov 08 15:52:48 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:52:48 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:52:48 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:52:48 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:52:48 user nova-compute[74788]:   </clock>
Nov 08 15:52:48 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:52:48 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:52:48 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:52:48 user nova-compute[74788]:   </cpu>
Nov 08 15:52:48 user nova-compute[74788]:   <devices>
Nov 08 15:52:48 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:52:48 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:52:48 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk"/>
Nov 08 15:52:48 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:52:48 user nova-compute[74788]:     </disk>
Nov 08 15:52:48 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:52:48 user nova-compute[74788]:       <mac address="fa:16:3e:4d:78:5c"/>
Nov 08 15:52:48 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:52:48 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:52:48 user nova-compute[74788]:       <target dev="tap51589533-18"/>
Nov 08 15:52:48 user nova-compute[74788]:     </interface>
Nov 08 15:52:48 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:52:48 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/console.log" append="off"/>
Nov 08 15:52:48 user nova-compute[74788]:     </serial>
Nov 08 15:52:48 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:52:48 user nova-compute[74788]:     <video>
Nov 08 15:52:48 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:52:48 user nova-compute[74788]:     </video>
Nov 08 15:52:48 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:52:48 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:52:48 user nova-compute[74788]:     </rng>
Nov 08 15:52:48 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:52:48 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:52:48 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:52:48 user nova-compute[74788]:     </memballoon>
Nov 08 15:52:48 user nova-compute[74788]:   </devices>
Nov 08 15:52:48 user nova-compute[74788]: </domain>
Nov 08 15:52:48 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266898929',display_name='tempest-SnapshotDataIntegrityTests-server-266898929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266898929',id=50,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNxg2/14LhD8CA+yAs64juG3u+dnQxGpTeiOsbKNZYZg6OR3HRpt0n6xwGRQx8ZConYKht1gqpVam9nhrULkimEJ2uowPChgggBJcT+p1VePQT787VpBvsC8hKzcUSZg==',key_name='tempest-keypair-248206686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38f471aa860a48c1be9521823c6e2c0d',ramdisk_id='',reservation_id='r-9dd4r8h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1540293599',owner_user_name='tempest-SnapshotDataIntegrityTests-1540293599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d618fd4a25eb4fbc8ca846939c2745b3',uuid=ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converting VIF {"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG os_vif [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16bbdd39-3aec-5f2b-ab13-5bf945c61b66', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51589533-18, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51589533-18, col_values=(('qos', UUID('00f4f3f6-7a4d-43d6-b562-33393560737a')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51589533-18, col_values=(('external_ids', {'iface-id': '51589533-181b-4af7-a188-5780843f2a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:78:5c', 'vm-uuid': 'ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:48 user nova-compute[74788]: INFO os_vif [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18')
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No VIF found with MAC fa:16:3e:4d:78:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updated VIF entry in instance network info cache for port 51589533-181b-4af7-a188-5780843f2a66. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG nova.network.neutron [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9e099ecb-850a-4188-9be6-930ea53803c0 req-a24c2a61-f293-464d-9781-9fd1e03cc350 service nova] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:52:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.compute.manager [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] No waiting events found dispatching network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:52:51 user nova-compute[74788]: WARNING nova.compute.manager [req-8331b956-e290-4200-975d-6286f67583ab req-7ee05ffb-4f9b-4663-b7db-9de06f6e4e81 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received unexpected event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 for instance with vm_state building and task_state spawning.
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:52:51 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Instance spawned successfully.
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:51 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:52:52 user nova-compute[74788]: INFO nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 08 15:52:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:52:52 user nova-compute[74788]: INFO nova.compute.manager [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Took 6.27 seconds to build instance.
Nov 08 15:52:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-89dc9077-e2ee-41e4-8f61-88846a48840c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.539s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:52 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:52:52 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:52:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] No waiting events found dispatching network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:52:53 user nova-compute[74788]: WARNING nova.compute.manager [req-fc89f647-b0a7-4109-a647-d9bed765561f req-4346aee7-ecc0-411f-b5ee-10fd5c139e01 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received unexpected event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 for instance with vm_state active and task_state None.
Nov 08 15:52:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:52:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:53:04 user nova-compute[74788]: INFO nova.compute.claims [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Claim successful on node user
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 15:53:04 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 15:53:04 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 15:53:05 user nova-compute[74788]: INFO nova.virt.block_device [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Booting with volume e7baf0b2-bb8c-4bb0-b9d1-80e759888122 at /dev/vda
Nov 08 15:53:05 user nova-compute[74788]: DEBUG nova.policy [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dcf0cfe564c46b7b010055cdd0dd6f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad34415d349442d91bc7d6590ff00f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.utils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7fb11a-0978-4388-8eda-004a30243e6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94f893-2fdd-4b61-ae4d-c24ef9203951]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[52400506-fefa-4f95-9d9e-0882b610c57f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb1d799-94ae-42df-974f-6003119ca9be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:53:05 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:53:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13661e-9466-4475-91c8-7aa24345fe80]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG os_brick.utils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:53:05 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating existing volume attachment record: 783bbe7e-9f36-49de-b41a-35eddab39e16 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Successfully created port: f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:53:06 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Creating image(s)
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Ensure instance console log exists: /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start _get_guest_xml network_info=[{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '350d485c-76fa-4afb-ab9f-0c8b26cd60d4', 'attached_at': '', 'detached_at': '', 'volume_id': '8f7c9602-16de-4455-b85e-5311a3b415fc', 'serial': '8f7c9602-16de-4455-b85e-5311a3b415fc'}, 'attachment_id': '8dda88c5-a955-46e3-b7d8-28333696a393', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:53:06 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:06 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:53:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:53:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:53:06 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f0a5f-9dc8-4d8b-91c0-2877cbe1bce4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:53:06 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a978d4d-8b4f-49c7-91b9-82b924f3501e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc] added
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda4850-5d93-438a-a437-b29053036d43]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca72db-ac95-4e25-8aa9-6f83f19bf769]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPlQaJsK {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPlQaJsK" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f71cef-7281-4bdb-88e6-42c5c906ea2a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPlQaJsK'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c808365c-8c80-4d8e-afdc-2b26edac769a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3113173-5759-4457-8d87-e8f495b4053c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9d531-5864-4c38-b4e2-49abc6199314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260]
Nov 08 15:53:06 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260] successful.
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Successfully updated port: f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fad2ce-a39f-4679-a6a3-bb51f9ab2b1e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5553f02f-ec6a-4d5e-a00f-f1d0e8c0a1c6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:06 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:06 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:06 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d677645-04ee-418a-91a3-ae60e16c8ead]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.compute.manager [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing instance network info cache due to event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:06 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.neutron [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance network_info: |[{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.neutron [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.neutron [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updated VIF entry in instance network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.neutron [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46b6aaf6-e1f1-43a0-a4b3-908563699607 req-58d87d88-6b79-4ed1-afd9-4117d54ae3bd service nova] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26536346362383536', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536346362383536', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1206809306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1206809306',id=49,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ihwmtdbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:52:22Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=350d485c-76fa-4afb-ab9f-0c8b26cd60d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.objects.instance [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:53:07 user nova-compute[74788]:   <uuid>350d485c-76fa-4afb-ab9f-0c8b26cd60d4</uuid>
Nov 08 15:53:07 user nova-compute[74788]:   <name>instance-00000031</name>
Nov 08 15:53:07 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:53:07 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:53:07 user nova-compute[74788]:   <metadata>
Nov 08 15:53:07 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:53:07 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1206809306</nova:name>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:53:06</nova:creationTime>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:53:07 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:53:07 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:owner>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:53:07 user nova-compute[74788]:       </nova:owner>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:53:07 user nova-compute[74788]:       <nova:ports>
Nov 08 15:53:07 user nova-compute[74788]:         <nova:port uuid="7f68dd32-fce9-4fcb-836e-b6dae2626762">
Nov 08 15:53:07 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 15:53:07 user nova-compute[74788]:         </nova:port>
Nov 08 15:53:07 user nova-compute[74788]:       </nova:ports>
Nov 08 15:53:07 user nova-compute[74788]:     </nova:instance>
Nov 08 15:53:07 user nova-compute[74788]:   </metadata>
Nov 08 15:53:07 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:53:07 user nova-compute[74788]:     <system>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="serial">350d485c-76fa-4afb-ab9f-0c8b26cd60d4</entry>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="uuid">350d485c-76fa-4afb-ab9f-0c8b26cd60d4</entry>
Nov 08 15:53:07 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:53:07 user nova-compute[74788]:     </system>
Nov 08 15:53:07 user nova-compute[74788]:   </sysinfo>
Nov 08 15:53:07 user nova-compute[74788]:   <os>
Nov 08 15:53:07 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:53:07 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:53:07 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:53:07 user nova-compute[74788]:   </os>
Nov 08 15:53:07 user nova-compute[74788]:   <features>
Nov 08 15:53:07 user nova-compute[74788]:     <acpi/>
Nov 08 15:53:07 user nova-compute[74788]:     <apic/>
Nov 08 15:53:07 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:53:07 user nova-compute[74788]:   </features>
Nov 08 15:53:07 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:53:07 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:53:07 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:53:07 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:53:07 user nova-compute[74788]:   </clock>
Nov 08 15:53:07 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:53:07 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:53:07 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:53:07 user nova-compute[74788]:   </cpu>
Nov 08 15:53:07 user nova-compute[74788]:   <devices>
Nov 08 15:53:07 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:53:07 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:53:07 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:53:07 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:53:07 user nova-compute[74788]:       <serial>8f7c9602-16de-4455-b85e-5311a3b415fc</serial>
Nov 08 15:53:07 user nova-compute[74788]:     </disk>
Nov 08 15:53:07 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:53:07 user nova-compute[74788]:       <mac address="fa:16:3e:c5:cb:19"/>
Nov 08 15:53:07 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:53:07 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:53:07 user nova-compute[74788]:       <target dev="tap7f68dd32-fc"/>
Nov 08 15:53:07 user nova-compute[74788]:     </interface>
Nov 08 15:53:07 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:53:07 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/console.log" append="off"/>
Nov 08 15:53:07 user nova-compute[74788]:     </serial>
Nov 08 15:53:07 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:53:07 user nova-compute[74788]:     <video>
Nov 08 15:53:07 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:53:07 user nova-compute[74788]:     </video>
Nov 08 15:53:07 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:53:07 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:53:07 user nova-compute[74788]:     </rng>
Nov 08 15:53:07 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:53:07 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:53:07 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:53:07 user nova-compute[74788]:     </memballoon>
Nov 08 15:53:07 user nova-compute[74788]:   </devices>
Nov 08 15:53:07 user nova-compute[74788]: </domain>
Nov 08 15:53:07 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1206809306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1206809306',id=49,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ihwmtdbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:52:22Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=350d485c-76fa-4afb-ab9f-0c8b26cd60d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG os_vif [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fc05f9f-aaef-5c61-b13a-72dd7eb7da88', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f68dd32-fc, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f68dd32-fc, col_values=(('qos', UUID('eac4c290-e5ab-4daf-9171-f240395c7b54')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f68dd32-fc, col_values=(('external_ids', {'iface-id': '7f68dd32-fce9-4fcb-836e-b6dae2626762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:cb:19', 'vm-uuid': '350d485c-76fa-4afb-ab9f-0c8b26cd60d4'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:07 user nova-compute[74788]: INFO os_vif [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc')
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:53:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:c5:cb:19, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:53:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:53:09 user nova-compute[74788]: WARNING nova.compute.manager [req-5a68ef95-66d3-4f2d-8e66-2b11d18f2f7c req-5f228301-1105-40bc-a088-35b106ebd8ba service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state building and task_state spawning.
Nov 08 15:53:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:53:11 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:11 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.029129028320312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:53:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance spawned successfully.
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:53:11 user nova-compute[74788]: INFO nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.manager [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:53:11 user nova-compute[74788]: WARNING nova.compute.manager [req-afd048b6-ae59-4d0c-9d60-b1c46053c822 req-c2744e63-4013-4d27-98fe-436852442e61 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state building and task_state spawning.
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:53:11 user nova-compute[74788]: INFO nova.compute.manager [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Took 50.37 seconds to build instance.
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-06787a75-50dc-4aa3-9cbb-645b8f99c7bf tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.465s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:53:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:53:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:19 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:53:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:53:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:53:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:53:28 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Creating image(s)
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Ensure instance console log exists: /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start _get_guest_xml network_info=[{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d156604-74f0-48ee-8fd8-8d4bad6b7a35', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'serial': 'e7baf0b2-bb8c-4bb0-b9d1-80e759888122'}, 'attachment_id': '783bbe7e-9f36-49de-b41a-35eddab39e16', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:53:28 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:28 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:53:28 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:53:28 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:53:28 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed15d4a-417d-40a0-a8de-400f6d9ed4b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:53:28 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872f843-d8e0-4020-b60b-bbf9d137cc49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122] added
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e80635-df66-41f6-84dd-d316cd60bd32]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3d487-b8dd-4b14-95af-68e30f1fbc02]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkrDfwHx {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkrDfwHx" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acbedc5-91d4-4d4b-8301-924e957bebd9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkrDfwHx'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[433860c6-80b9-4a8d-8dda-c7b4899e7b98]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc00dd8-f6e2-4cf5-9ee4-732241872993]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e567cf88-04c0-47ab-8d2c-7c8a220a5c9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]
Nov 08 15:53:28 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2760401-fc35-40eb-9270-694d93d51a06]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df77dab-9e86-4020-81b2-d296b4d51127]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:53:28 user nova-compute[74788]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:53:28 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e494cd-26c8-4e54-9016-4f7288dba70b]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:53:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23836656664623831', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836656664623831', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemo86h1yXlN9WbZx3TL7vgJ4VVMR/1eHd89UbjL6P9NODl+HhlDXS326cJuW8EsM40KuvAj6peMMNRdQoMdUQnvKtPUiRL8TJqrFnwa6/L10mAJFNdwRme+2Jt27U8TA==',key_name='tempest-TestShelveInstance-1337526013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:53:05Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.objects.instance [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:53:29 user nova-compute[74788]:   <uuid>4d156604-74f0-48ee-8fd8-8d4bad6b7a35</uuid>
Nov 08 15:53:29 user nova-compute[74788]:   <name>instance-00000033</name>
Nov 08 15:53:29 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:53:29 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:53:29 user nova-compute[74788]:   <metadata>
Nov 08 15:53:29 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:53:29 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:53:29 user nova-compute[74788]:       <nova:name>tempest-TestShelveInstance-server-140683081</nova:name>
Nov 08 15:53:29 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:53:28</nova:creationTime>
Nov 08 15:53:29 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:53:29 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:53:29 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:53:29 user nova-compute[74788]:       <nova:owner>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:user uuid="6dcf0cfe564c46b7b010055cdd0dd6f2">tempest-TestShelveInstance-1817171713-project-member</nova:user>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:project uuid="6ad34415d349442d91bc7d6590ff00f4">tempest-TestShelveInstance-1817171713</nova:project>
Nov 08 15:53:29 user nova-compute[74788]:       </nova:owner>
Nov 08 15:53:29 user nova-compute[74788]:       <nova:ports>
Nov 08 15:53:29 user nova-compute[74788]:         <nova:port uuid="f8a2871c-bf0a-427e-9da1-d4abbf22499e">
Nov 08 15:53:29 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:53:29 user nova-compute[74788]:         </nova:port>
Nov 08 15:53:29 user nova-compute[74788]:       </nova:ports>
Nov 08 15:53:29 user nova-compute[74788]:     </nova:instance>
Nov 08 15:53:29 user nova-compute[74788]:   </metadata>
Nov 08 15:53:29 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:53:29 user nova-compute[74788]:     <system>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="serial">4d156604-74f0-48ee-8fd8-8d4bad6b7a35</entry>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="uuid">4d156604-74f0-48ee-8fd8-8d4bad6b7a35</entry>
Nov 08 15:53:29 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:53:29 user nova-compute[74788]:     </system>
Nov 08 15:53:29 user nova-compute[74788]:   </sysinfo>
Nov 08 15:53:29 user nova-compute[74788]:   <os>
Nov 08 15:53:29 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:53:29 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:53:29 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:53:29 user nova-compute[74788]:   </os>
Nov 08 15:53:29 user nova-compute[74788]:   <features>
Nov 08 15:53:29 user nova-compute[74788]:     <acpi/>
Nov 08 15:53:29 user nova-compute[74788]:     <apic/>
Nov 08 15:53:29 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:53:29 user nova-compute[74788]:   </features>
Nov 08 15:53:29 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:53:29 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:53:29 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:53:29 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:53:29 user nova-compute[74788]:   </clock>
Nov 08 15:53:29 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:53:29 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:53:29 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:53:29 user nova-compute[74788]:   </cpu>
Nov 08 15:53:29 user nova-compute[74788]:   <devices>
Nov 08 15:53:29 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:53:29 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:53:29 user nova-compute[74788]:       <source dev="/dev/sdc"/>
Nov 08 15:53:29 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:53:29 user nova-compute[74788]:       <serial>e7baf0b2-bb8c-4bb0-b9d1-80e759888122</serial>
Nov 08 15:53:29 user nova-compute[74788]:     </disk>
Nov 08 15:53:29 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:53:29 user nova-compute[74788]:       <mac address="fa:16:3e:30:01:0d"/>
Nov 08 15:53:29 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:53:29 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:53:29 user nova-compute[74788]:       <target dev="tapf8a2871c-bf"/>
Nov 08 15:53:29 user nova-compute[74788]:     </interface>
Nov 08 15:53:29 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:53:29 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35/console.log" append="off"/>
Nov 08 15:53:29 user nova-compute[74788]:     </serial>
Nov 08 15:53:29 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:53:29 user nova-compute[74788]:     <video>
Nov 08 15:53:29 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:53:29 user nova-compute[74788]:     </video>
Nov 08 15:53:29 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:53:29 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:53:29 user nova-compute[74788]:     </rng>
Nov 08 15:53:29 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:53:29 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:53:29 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:53:29 user nova-compute[74788]:     </memballoon>
Nov 08 15:53:29 user nova-compute[74788]:   </devices>
Nov 08 15:53:29 user nova-compute[74788]: </domain>
Nov 08 15:53:29 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemo86h1yXlN9WbZx3TL7vgJ4VVMR/1eHd89UbjL6P9NODl+HhlDXS326cJuW8EsM40KuvAj6peMMNRdQoMdUQnvKtPUiRL8TJqrFnwa6/L10mAJFNdwRme+2Jt27U8TA==',key_name='tempest-TestShelveInstance-1337526013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:53:05Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG os_vif [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd39644e3-b27f-571b-873f-82c629e4d4dc', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8a2871c-bf, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8a2871c-bf, col_values=(('qos', UUID('6b5598f6-aead-4955-91a9-f1e26da2ea36')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8a2871c-bf, col_values=(('external_ids', {'iface-id': 'f8a2871c-bf0a-427e-9da1-d4abbf22499e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:01:0d', 'vm-uuid': '4d156604-74f0-48ee-8fd8-8d4bad6b7a35'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:29 user nova-compute[74788]: INFO os_vif [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf')
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:53:29 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] No VIF found with MAC fa:16:3e:30:01:0d, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:53:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG nova.compute.manager [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:53:31 user nova-compute[74788]: WARNING nova.compute.manager [req-64a38f14-ede9-4fd4-89be-efd85406e8fa req-825d3844-b9d7-46e1-966d-b9e350010a2d service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state building and task_state spawning.
Nov 08 15:53:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:53:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance spawned successfully.
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 15:53:33 user nova-compute[74788]: INFO nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG nova.compute.manager [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:53:33 user nova-compute[74788]: WARNING nova.compute.manager [req-7a492aae-99b1-4513-9df6-03791487edec req-b6192915-6767-4506-a9b6-65d51cb28981 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state building and task_state spawning.
Nov 08 15:53:33 user nova-compute[74788]: INFO nova.compute.manager [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Took 28.78 seconds to build instance.
Nov 08 15:53:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-c7f9354f-55b3-4fdc-afcc-87d472d660a1 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.876s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:53:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:53:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:01 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:54:08 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updating instance_info_cache with network_info: [{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:54:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:54:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:54:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:54:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=25.02539825439453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:54:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:54:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:17 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:17 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:17 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:54:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:54:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-changed-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:54:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Refreshing instance network info cache due to event network-changed-51589533-181b-4af7-a188-5780843f2a66. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:54:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:54:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:54:36 user nova-compute[74788]: DEBUG nova.network.neutron [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Refreshing network info cache for port 51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:54:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updated VIF entry in instance network info cache for port 51589533-181b-4af7-a188-5780843f2a66. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:54:37 user nova-compute[74788]: DEBUG nova.network.neutron [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:54:37 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11f6ea65-f01e-4755-9df2-32c64900766c req-ffe0aafb-0da5-4ffa-b72d-00eb5287c2b2 service nova] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:54:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:43 user nova-compute[74788]: INFO nova.compute.manager [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attaching volume 242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 to /dev/vdb
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[849734d0-883a-49f5-a821-b754f759a59c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14bea1-9fb6-427f-8afa-996735cd7e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb4920-fd23-411f-b3f7-2e5212a6603b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d8a85-8709-4cef-af58-808a739d9cef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:54:43 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:54:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40937a-cf21-47af-af96-fb8b4ca9249c]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating existing volume attachment record: 89c33627-1070-4b6c-b995-68e9a4e30d58 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:54:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG nova.compute.manager [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing instance network info cache due to event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updated VIF entry in instance network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:54:56 user nova-compute[74788]: DEBUG nova.network.neutron [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-445367e3-b09b-4f64-a79a-95c50da32c60 req-10aa780c-95c2-4036-ab40-b27506272807 service nova] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:57 user nova-compute[74788]: INFO nova.compute.manager [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Shelve offloading
Nov 08 15:54:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:58 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance destroyed successfully.
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.network.neutron [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:54:58 user nova-compute[74788]: WARNING nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state active and task_state shelving.
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:54:58 user nova-compute[74788]: DEBUG nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:54:58 user nova-compute[74788]: WARNING nova.compute.manager [req-46fac701-d653-4e46-80df-88687feeac0e req-1a0419ea-9311-488d-93c6-c6d0ad0411be service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state active and task_state shelving.
Nov 08 15:54:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance destroyed successfully.
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'resources' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemo86h1yXlN9WbZx3TL7vgJ4VVMR/1eHd89UbjL6P9NODl+HhlDXS326cJuW8EsM40KuvAj6peMMNRdQoMdUQnvKtPUiRL8TJqrFnwa6/L10mAJFNdwRme+2Jt27U8TA==',key_name='tempest-TestShelveInstance-1337526013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:53:33Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_vif [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8a2871c-bf, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b5598f6-aead-4955-91a9-f1e26da2ea36) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing instance network info cache due to event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:54:59 user nova-compute[74788]: INFO os_vif [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf')
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:54:59 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2516bc2d-1680-43ba-b6d8-817dc6fe4f29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:54:59 user nova-compute[74788]: No targets found.
Nov 08 15:54:59 user nova-compute[74788]: iSNS:
Nov 08 15:54:59 user nova-compute[74788]: No targets found.
Nov 08 15:54:59 user nova-compute[74788]: STATIC:
Nov 08 15:54:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:54:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:54:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:54:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122
Nov 08 15:54:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:54:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:54:59 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:54:59 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:54:59 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:54:59 user nova-compute[74788]: FIRMWARE:
Nov 08 15:54:59 user nova-compute[74788]: No targets found.
Nov 08 15:54:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:54:59 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:54:59 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c543882-ba44-42b3-b817-c4483644f915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afff4cc-0ce3-495b-94db-1b58a0a6db26]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:54:59 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:54:59 user nova-compute[74788]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:54:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:54:59 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:54:59 user nova-compute[74788]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:54:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f775836c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4c1f4-effc-4fd2-b261-7e4d4da48b85]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354b753-fb13-4005-b218-7b63c7f767c3]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d00bce5-4d9c-42d6-b98e-1e2b0312e73a]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2ad00-07d7-481a-affa-ba38c3878b90]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dc8e25-a806-462f-88d3-6a518f8ef0db]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e33978-c328-415b-9984-1430adfa809b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]
Nov 08 15:54:59 user nova-compute[74788]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.
Nov 08 15:54:59 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a0b089-edbc-4e0a-8a24-3b774fc355b5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== disconnect_volume: return (302ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:54:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deleting instance files /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35_del
Nov 08 15:54:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deletion of /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35_del complete
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updated VIF entry in instance network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG nova.network.neutron [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": null, "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:54:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f527c402-cfb3-4042-b00b-98c0ab6a017e req-725fabe6-a8d3-454d-8b52-a3a556c7d12f service nova] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:55:00 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Deleted allocations for instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35
Nov 08 15:55:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:00 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:00 user nova-compute[74788]: DEBUG nova.objects.base [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Object Instance<4d156604-74f0-48ee-8fd8-8d4bad6b7a35> lazy-loaded attributes: resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:55:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:55:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b08e6752-caf8-419d-a5a6-c75dc470a2ba tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.786s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:02 user nova-compute[74788]: INFO nova.compute.manager [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Rescuing
Nov 08 15:55:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG nova.network.neutron [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:02 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG nova.compute.manager [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:55:03 user nova-compute[74788]: WARNING nova.compute.manager [req-a657d193-cfd3-467f-b3e2-3b55f82ae8b1 req-37af9012-f531-4572-8243-faf9bde8cf9e service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state active and task_state rescuing.
Nov 08 15:55:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance destroyed successfully.
Nov 08 15:55:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Attempting a stable device rescue
Nov 08 15:55:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 15:55:03 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Creating image(s)
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'trusted_certs' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:03 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG nova.virt.images [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] 8bc8e1b6-4796-4192-a400-5d0b95e2e896 was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 15:55:04 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.part /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.part /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.converted" returned: 0 in 0.311s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.compute.manager [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:55:05 user nova-compute[74788]: WARNING nova.compute.manager [req-ab4a7434-ddc4-4a71-ae11-0589ea5a73d5 req-2c1c00f9-c912-45c2-a652-aa6660749cff service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state active and task_state rescuing.
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.763s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7,backing_fmt=raw /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4a6db373da6c49cacfe653caf121edf6d64f90a7,backing_fmt=raw /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue" returned: 0 in 0.049s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "4a6db373da6c49cacfe653caf121edf6d64f90a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'migration_context' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<350d485c-76fa-4afb-ab9f-0c8b26cd60d4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start _get_guest_xml network_info=[{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:c5:cb:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bc8e1b6-4796-4192-a400-5d0b95e2e896', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '350d485c-76fa-4afb-ab9f-0c8b26cd60d4', 'attached_at': '', 'detached_at': '', 'volume_id': '8f7c9602-16de-4455-b85e-5311a3b415fc', 'serial': '8f7c9602-16de-4455-b85e-5311a3b415fc'}, 'attachment_id': '8dda88c5-a955-46e3-b7d8-28333696a393', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<350d485c-76fa-4afb-ab9f-0c8b26cd60d4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'numa_topology' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<350d485c-76fa-4afb-ab9f-0c8b26cd60d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:55:05 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'vcpu_model' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<350d485c-76fa-4afb-ab9f-0c8b26cd60d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:55:05 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:55:05 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:55:05 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed93e2d-2c51-4ce3-88ae-7fb05d693aae]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tPlQaJsK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 15:55:05 user nova-compute[74788]: node.name = iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:55:05 user nova-compute[74788]: node.tpgt = -1
Nov 08 15:55:05 user nova-compute[74788]: node.startup = automatic
Nov 08 15:55:05 user nova-compute[74788]: node.leading_login = No
Nov 08 15:55:05 user nova-compute[74788]: iface.iscsi_ifacename = default
Nov 08 15:55:05 user nova-compute[74788]: iface.net_ifacename = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.ipaddress = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.prefix_len = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.hwaddress = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.transport_name = tcp
Nov 08 15:55:05 user nova-compute[74788]: iface.initiatorname = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.vlan_id = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.vlan_priority = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.vlan_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.iface_num = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.mtu = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.port = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.bootproto = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.subnet_mask = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.gateway = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_alt_client_id = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_dns = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_learn_iqn = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_vendor_id_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_vendor_id = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.dhcp_slp_da = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.fragmentation = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.gratuitous_arp = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.incoming_forwarding = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.tos_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.tos = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.ttl = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.delayed_ack = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.tcp_nagle = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.tcp_wsf_state = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.tcp_wsf = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.tcp_timer_scale = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.tcp_timestamp = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.redirect = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.def_task_mgmt_timeout = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.header_digest = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.data_digest = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.immediate_data = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.initial_r2t = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.data_seq_inorder = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.data_pdu_inorder = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.erl = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.max_receive_data_len = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.first_burst_len = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.max_outstanding_r2t = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.max_burst_len = 0
Nov 08 15:55:05 user nova-compute[74788]: iface.chap_auth = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.bidi_chap = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.strict_login_compliance = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.discovery_auth = <empty>
Nov 08 15:55:05 user nova-compute[74788]: iface.discovery_logout = <empty>
Nov 08 15:55:05 user nova-compute[74788]: node.discovery_address = <empty>
Nov 08 15:55:05 user nova-compute[74788]: node.discovery_port = 0
Nov 08 15:55:05 user nova-compute[74788]: node.discovery_type = static
Nov 08 15:55:05 user nova-compute[74788]: node.session.initial_cmdsn = 0
Nov 08 15:55:05 user nova-compute[74788]: node.session.initial_login_retry_max = 8
Nov 08 15:55:05 user nova-compute[74788]: node.session.xmit_thread_priority = -20
Nov 08 15:55:05 user nova-compute[74788]: node.session.cmds_max = 128
Nov 08 15:55:05 user nova-compute[74788]: node.session.queue_depth = 32
Nov 08 15:55:05 user nova-compute[74788]: node.session.nr_sessions = 1
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.authmethod = CHAP
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.username = tPlQaJsK
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.password = ***
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.username_in = <empty>
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.password_in = <empty>
Nov 08 15:55:05 user nova-compute[74788]: node.session.auth.chap_algs = MD5
Nov 08 15:55:05 user nova-compute[74788]: node.session.timeo.replacement_timeout = 120
Nov 08 15:55:05 user nova-compute[74788]: node.session.err_timeo.abort_timeout = 15
Nov 08 15:55:05 user nova-compute[74788]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 15:55:05 user nova-compute[74788]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 15:55:05 user nova-compute[74788]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.FastAbort = Yes
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.InitialR2T = No
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.ImmediateData = Yes
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.MaxConnections = 1
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 15:55:05 user nova-compute[74788]: node.session.iscsi.ERL = 0
Nov 08 15:55:05 user nova-compute[74788]: node.session.scan = manual
Nov 08 15:55:05 user nova-compute[74788]: node.session.reopen_max = 0
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].address = 172.16.0.220
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].port = 3260
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].startup = manual
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].tcp.window_size = 524288
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].tcp.type_of_service = 0
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].timeo.logout_timeout = 15
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].timeo.login_timeout = 15
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].timeo.auth_timeout = 45
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.DataDigest = None
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.IFMarker = No
Nov 08 15:55:05 user nova-compute[74788]: node.conn[0].iscsi.OFMarker = No
Nov 08 15:55:05 user nova-compute[74788]: # END RECORD
Nov 08 15:55:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a765d3f-f037-40cf-9823-c788591412d6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab00894-8a27-4208-9c25-305a0f219316]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPlQaJsK {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPlQaJsK" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45bc75-6cde-4fd2-bbc4-96fd1295f124]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPlQaJsK'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f41517-d5d8-4af5-b7cc-6c1acd691000]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c4329e-002d-49ab-b945-12eafea197cc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:05 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:05 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:05 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] HCTL ('33', '0', '0', 0) found on session 52 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa743bb-dcb9-454c-8fc5-ea1e6da3c9f0]: (4, ('0 0 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Searching for a device in session 52 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '26536346362383536', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536346362383536', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1206809306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1206809306',id=49,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ihwmtdbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T15:53:11Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=350d485c-76fa-4afb-ab9f-0c8b26cd60d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:c5:cb:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "vif_mac": "fa:16:3e:c5:cb:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'pci_devices' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.objects.base [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Object Instance<350d485c-76fa-4afb-ab9f-0c8b26cd60d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:55:05 user nova-compute[74788]:   <uuid>350d485c-76fa-4afb-ab9f-0c8b26cd60d4</uuid>
Nov 08 15:55:05 user nova-compute[74788]:   <name>instance-00000031</name>
Nov 08 15:55:05 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:55:05 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:55:05 user nova-compute[74788]:   <metadata>
Nov 08 15:55:05 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:55:05 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1206809306</nova:name>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:55:05</nova:creationTime>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:55:05 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:55:05 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:owner>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:user uuid="8015e2645eac4fefb444c80dd1922ef2">tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member</nova:user>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:project uuid="c6442811e582464cb1edd2a82d930bac">tempest-ServerBootFromVolumeStableRescueTest-1899251386</nova:project>
Nov 08 15:55:05 user nova-compute[74788]:       </nova:owner>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 15:55:05 user nova-compute[74788]:       <nova:ports>
Nov 08 15:55:05 user nova-compute[74788]:         <nova:port uuid="7f68dd32-fce9-4fcb-836e-b6dae2626762">
Nov 08 15:55:05 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 15:55:05 user nova-compute[74788]:         </nova:port>
Nov 08 15:55:05 user nova-compute[74788]:       </nova:ports>
Nov 08 15:55:05 user nova-compute[74788]:     </nova:instance>
Nov 08 15:55:05 user nova-compute[74788]:   </metadata>
Nov 08 15:55:05 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:55:05 user nova-compute[74788]:     <system>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="serial">350d485c-76fa-4afb-ab9f-0c8b26cd60d4</entry>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="uuid">350d485c-76fa-4afb-ab9f-0c8b26cd60d4</entry>
Nov 08 15:55:05 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:55:05 user nova-compute[74788]:     </system>
Nov 08 15:55:05 user nova-compute[74788]:   </sysinfo>
Nov 08 15:55:05 user nova-compute[74788]:   <os>
Nov 08 15:55:05 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:55:05 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:55:05 user nova-compute[74788]:   </os>
Nov 08 15:55:05 user nova-compute[74788]:   <features>
Nov 08 15:55:05 user nova-compute[74788]:     <acpi/>
Nov 08 15:55:05 user nova-compute[74788]:     <apic/>
Nov 08 15:55:05 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:55:05 user nova-compute[74788]:   </features>
Nov 08 15:55:05 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:55:05 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:55:05 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:55:05 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:55:05 user nova-compute[74788]:   </clock>
Nov 08 15:55:05 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:55:05 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:55:05 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:55:05 user nova-compute[74788]:   </cpu>
Nov 08 15:55:05 user nova-compute[74788]:   <devices>
Nov 08 15:55:05 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:55:05 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:55:05 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 15:55:05 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:55:05 user nova-compute[74788]:       <serial>8f7c9602-16de-4455-b85e-5311a3b415fc</serial>
Nov 08 15:55:05 user nova-compute[74788]:     </disk>
Nov 08 15:55:05 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 15:55:05 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 15:55:05 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue"/>
Nov 08 15:55:05 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 15:55:05 user nova-compute[74788]:       <boot order="1"/>
Nov 08 15:55:05 user nova-compute[74788]:     </disk>
Nov 08 15:55:05 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:55:05 user nova-compute[74788]:       <mac address="fa:16:3e:c5:cb:19"/>
Nov 08 15:55:05 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:55:05 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:55:05 user nova-compute[74788]:       <target dev="tap7f68dd32-fc"/>
Nov 08 15:55:05 user nova-compute[74788]:     </interface>
Nov 08 15:55:05 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:55:05 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/console.log" append="off"/>
Nov 08 15:55:05 user nova-compute[74788]:     </serial>
Nov 08 15:55:05 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:55:05 user nova-compute[74788]:     <video>
Nov 08 15:55:05 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:55:05 user nova-compute[74788]:     </video>
Nov 08 15:55:05 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:55:05 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:55:05 user nova-compute[74788]:     </rng>
Nov 08 15:55:05 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:55:05 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:55:05 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:55:05 user nova-compute[74788]:     </memballoon>
Nov 08 15:55:05 user nova-compute[74788]:   </devices>
Nov 08 15:55:05 user nova-compute[74788]: </domain>
Nov 08 15:55:05 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:55:05 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance destroyed successfully.
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:55:05 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] No VIF found with MAC fa:16:3e:c5:cb:19, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FniOSWdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:55:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:55:06 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:55:06 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:55:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f15fd-cfe7-43eb-85e6-6a66d2e618c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:55:06 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:06 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d41eb4-a9dc-4027-ada1-769e0d997499]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3] added
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a631ce-d7a9-4f02-b82a-267331abe2a0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac13bbe-fb58-4ded-b539-2c625961c0be]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FniOSWdf {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FniOSWdf" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656d4a8-e693-4a2a-aae2-e9487b7616f8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FniOSWdf'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f4ff0-9389-456d-8f11-e22cb153b728]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d38e4f8-a82b-45e8-a7c6-209f61c5d748]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd34e8-4304-4639-b945-a12220314e08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260]
Nov 08 15:55:07 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260] successful.
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e69a8cc-a5fa-4fdb-a9b3-58d24629c2d3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5f32c-493b-4317-aadc-7fc0c872f32a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:55:07 user nova-compute[74788]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)
Nov 08 15:55:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe80b0-6b77-4b71-a3cc-dd538ea75223]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FniOSWdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG nova.compute.manager [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:55:07 user nova-compute[74788]: WARNING nova.compute.manager [req-a902074e-ed05-4564-aef2-e7c74100b137 req-28f3acaf-3278-4875-aa8c-00692b4b28f9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state active and task_state rescuing.
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26234396465656338', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234396465656338', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:55:08 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:55:08 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:55:08 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:55:08 user nova-compute[74788]:   <serial>242f26d5-94e4-4fe6-8965-0ce6d65cdbe3</serial>
Nov 08 15:55:08 user nova-compute[74788]: </disk>
Nov 08 15:55:08 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No VIF found with MAC fa:16:3e:4d:78:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-1d36f285-397b-4a95-ae9d-8d033d2e35c2 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.536s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-df3619e9-7816-4fd8-99b7-2ff7e51864f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG nova.compute.manager [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:55:09 user nova-compute[74788]: WARNING nova.compute.manager [req-2d71ee6a-a3b0-4f5d-8ea8-52af3edd567b req-a758eac2-af47-4134-8768-ff75503cbd35 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state active and task_state rescuing.
Nov 08 15:55:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:55:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:55:11 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:55:11 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=24.929096221923828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:55:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:55:12 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:55:13 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:55:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:55:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:55:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:55:17 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:55:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:55:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:55:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:55:47 user nova-compute[74788]: INFO nova.compute.manager [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Detaching volume 242f26d5-94e4-4fe6-8965-0ce6d65cdbe3
Nov 08 15:55:47 user nova-compute[74788]: INFO nova.virt.block_device [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attempting to driver detach volume 242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 from mountpoint /dev/vdb
Nov 08 15:55:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Attempting to detach device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:55:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:55:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:55:47 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:55:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:55:47 user nova-compute[74788]:   <serial>242f26d5-94e4-4fe6-8965-0ce6d65cdbe3</serial>
Nov 08 15:55:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:55:47 user nova-compute[74788]: </disk>
Nov 08 15:55:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:55:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config.
Nov 08 15:55:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:55:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:55:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:55:47 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:55:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:55:47 user nova-compute[74788]:   <serial>242f26d5-94e4-4fe6-8965-0ce6d65cdbe3</serial>
Nov 08 15:55:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:55:47 user nova-compute[74788]: </disk>
Nov 08 15:55:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:55:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:55:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:55:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:04 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:07 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 is timed out.
Nov 08 15:56:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config.
Nov 08 15:56:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FniOSWdf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:56:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3e6e3-9109-49ef-acb2-e6d3f5065485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:56:07 user nova-compute[74788]: No targets found.
Nov 08 15:56:07 user nova-compute[74788]: iSNS:
Nov 08 15:56:07 user nova-compute[74788]: No targets found.
Nov 08 15:56:07 user nova-compute[74788]: STATIC:
Nov 08 15:56:07 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:56:07 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:56:07 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:56:07 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:56:07 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:56:07 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:56:07 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3
Nov 08 15:56:07 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:56:07 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:56:07 user nova-compute[74788]: FIRMWARE:
Nov 08 15:56:07 user nova-compute[74788]: No targets found.
Nov 08 15:56:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:56:07 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:56:07 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f7e40-cd28-44a0-a401-427431aa739a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85b93c-eea4-4ba5-b8c9-241b53da1444]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:56:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:56:07 user nova-compute[74788]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)
Nov 08 15:56:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:56:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:56:07 user nova-compute[74788]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 (non-flash)
Nov 08 15:56:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3319e184-548a-4ce5-ba2b-f98df113a00a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb70a7f-515c-4887-9c42-11725a330770]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d471a-ea6b-4f7a-a852-59cd1249de01]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b6713c-4f6d-44aa-88f6-1648924b5426]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10608871-bb92-4baf-9fcc-64dd0d70eefb]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e6348-bb55-4c21-befe-9a0db1d6283f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260]
Nov 08 15:56:08 user nova-compute[74788]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3, portal: 172.16.0.220,3260] successful.
Nov 08 15:56:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:242f26d5-94e4-4fe6-8965-0ce6d65cdbe3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c73de5-e1e8-49e3-9cec-2869efac02cd]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== disconnect_volume: return (299ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:08 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG nova.objects.instance [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3c34396d-fb9a-4599-89ad-9712476ef2c4 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:56:10 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=24.92654800415039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:56:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:56:11 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:56:11 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:56:11 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:56:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [{"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ebeaebbb-acd5-4f72-9b11-d81d85eca41f" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:56:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:56:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:19 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:56:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:43 user nova-compute[74788]: INFO nova.compute.manager [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attaching volume 66d2cb54-f2fa-4899-9f82-b9bb37e1de36 to /dev/vdb
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef229c6d-8665-4a0e-b64b-3fffc8de42b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[75856ea0-d5e4-4d2c-9e46-c87ae43d6c2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c50b8-698b-4266-8411-3e921b37cd68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2ae84-fcd4-4d12-be9d-7dd5f1abbb9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:56:43 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:56:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffc569b-01b6-40fe-8e8e-3111d8dd8eaa]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating existing volume attachment record: 82a0351f-6b2e-4e8e-b24e-c03d82198e25 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:56:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:48 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:48 user nova-compute[74788]: INFO nova.compute.manager [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Unshelving
Nov 08 15:56:49 user nova-compute[74788]: INFO nova.virt.block_device [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Booting with volume e7baf0b2-bb8c-4bb0-b9d1-80e759888122 at /dev/vda
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.utils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510f994-1064-43bb-af0b-a70f9b1b24f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d58c5e-978c-4136-b74c-56842a5cf605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46d993e-cbb6-422d-b46f-402ad15a07c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2fe7c4-8c05-4fe2-960c-ae2bd651d787]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:56:49 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:56:49 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af43fd-645c-4625-9581-3ca5682743bd]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG os_brick.utils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating existing volume attachment record: c4388559-05ba-40e5-a1c0-1644699fc298 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:56:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:56:52 user nova-compute[74788]: INFO nova.compute.manager [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Unrescuing
Nov 08 15:56:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:56:52 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquired lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:56:52 user nova-compute[74788]: DEBUG nova.network.neutron [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG nova.network.neutron [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Releasing lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG nova.objects.instance [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'flavor' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG nova.compute.manager [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:56:53 user nova-compute[74788]: WARNING nova.compute.manager [req-f211822b-5283-4a52-8515-90f1ec31671b req-ce6e272b-961b-4eee-84c8-8a620e8dd839 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:56:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:54 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance destroyed successfully.
Nov 08 15:56:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG nova.compute.manager [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:56:55 user nova-compute[74788]: WARNING nova.compute.manager [req-4e8398b2-7941-469e-b84c-72dc2a9a51f1 req-316b6118-554e-4d84-a62a-ec057a9ad2d9 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:56:57 user nova-compute[74788]: WARNING nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:56:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:56:57 user nova-compute[74788]: DEBUG nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:56:57 user nova-compute[74788]: WARNING nova.compute.manager [req-11290a3a-84bd-49cc-bc8a-d45c00d93853 req-b5116a0e-0e0b-44bd-99cf-fefce9ed2afe service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state rescued and task_state unrescuing.
Nov 08 15:56:57 user nova-compute[74788]: DEBUG nova.compute.manager [None req-47380f54-ee45-47d9-9fb8-5ef12ea01415 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:56:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:56:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:57:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZxhzisG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:57:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:57:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:57:07 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a1410-316e-41ce-9777-368e0e31dcf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:57:07 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5db24-bc8e-46af-9d12-878ae96391ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36] added
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3047de7-41f3-4a13-bd9f-f7c278dccf03]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec5254f-9399-4d2f-baca-0c98086975f3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZxhzisG {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZxhzisG" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda02cfe-5fac-4a96-b58f-df943e8d79f0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZxhzisG'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee667f-2b17-45de-8f87-5c82cb238be2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9be636-853c-4999-a266-90e0c3b1671c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86df99-9655-405f-b6a2-6c24f3a48913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260]
Nov 08 15:57:07 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260] successful.
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0acdff-7000-424a-8e81-e813d408c1a3]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108af95-7e90-4d7a-abda-df38d690986b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:07 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad4cca5-26c1-460e-bf66-3205dbcceb44]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:57:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZxhzisG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:57:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:57:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23832313632633036', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:57:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832313632633036', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:57:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:57:08 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:57:08 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:57:08 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:57:08 user nova-compute[74788]:   <serial>66d2cb54-f2fa-4899-9f82-b9bb37e1de36</serial>
Nov 08 15:57:08 user nova-compute[74788]: </disk>
Nov 08 15:57:08 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No VIF found with MAC fa:16:3e:4d:78:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5423596c-e979-42b5-bb3e-3b7028ea5972 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.689s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:57:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:57:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:57:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.92615509033203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:12 user nova-compute[74788]: INFO nova.compute.manager [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Detaching volume 66d2cb54-f2fa-4899-9f82-b9bb37e1de36
Nov 08 15:57:12 user nova-compute[74788]: INFO nova.virt.block_device [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attempting to driver detach volume 66d2cb54-f2fa-4899-9f82-b9bb37e1de36 from mountpoint /dev/vdb
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Attempting to detach device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:57:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:57:12 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:57:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:57:12 user nova-compute[74788]:   <serial>66d2cb54-f2fa-4899-9f82-b9bb37e1de36</serial>
Nov 08 15:57:12 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:57:12 user nova-compute[74788]: </disk>
Nov 08 15:57:12 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:57:12 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config.
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:57:12 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:57:12 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:57:12 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:57:12 user nova-compute[74788]:   <serial>66d2cb54-f2fa-4899-9f82-b9bb37e1de36</serial>
Nov 08 15:57:12 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:57:12 user nova-compute[74788]: </disk>
Nov 08 15:57:12 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:57:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.objects.instance [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.objects.instance [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 15:57:13 user nova-compute[74788]: INFO nova.compute.claims [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Claim successful on node user
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:13 user nova-compute[74788]: INFO nova.network.neutron [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating port f8a2871c-bf0a-427e-9da1-d4abbf22499e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.compute.manager [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing instance network info cache due to event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updating instance_info_cache with network_info: [{"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-8cd25306-3d05-41d6-90f8-b537cc59a94c" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 15:57:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Creating image(s)
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Did not create local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Ensure instance console log exists: /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start _get_guest_xml network_info=[{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d156604-74f0-48ee-8fd8-8d4bad6b7a35', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'serial': 'e7baf0b2-bb8c-4bb0-b9d1-80e759888122'}, 'attachment_id': 'c4388559-05ba-40e5-a1c0-1644699fc298', 'delete_on_termination': True, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.network.neutron [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:57:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:57:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:57:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.objects.instance [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.objects.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Object Instance<4d156604-74f0-48ee-8fd8-8d4bad6b7a35> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:57:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:57:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:57:14 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f9756-fd5f-4de1-a85e-8208eb87f4d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:57:14 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519972a-8a7c-4cb8-8d47-724a94807ef0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122] added
Nov 08 15:57:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0491f2-1c89-4dba-9faf-1288824de1f1]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb136b-fe0a-4841-88a3-f0b4becbb054]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkrDfwHx {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkrDfwHx" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb0fa7-f272-404a-8d96-708b6a62f771]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkrDfwHx'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0e0f26-28a6-4508-ab55-4d69cf4ce940]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41fdadc-df94-473a-a208-eb215258dcd2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:14 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:14 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:14 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:14 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:57:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a944b-6e4b-480c-b3f5-8031238b38ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]
Nov 08 15:57:15 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.
Nov 08 15:57:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a2817-b988-4443-a347-59f6099fc74e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244983d-0be0-4b79-ae51-d7d76d5a898f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:57:15 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f63409-6628-417a-89d7-bccb1e493d69]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updated VIF entry in instance network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG nova.network.neutron [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:57:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d19a723a-dd05-4a4b-baed-fbc08c243e06 req-f49eef9b-69e8-4049-a7ad-17eba278af40 service nova] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23836656664623831', 'path': '/dev/sdd'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836656664623831', 'path': '/dev/sdd'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1337526013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:56:49Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.objects.instance [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.objects.base [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Object Instance<4d156604-74f0-48ee-8fd8-8d4bad6b7a35> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] End _get_guest_xml xml=<domain type="kvm">
Nov 08 15:57:16 user nova-compute[74788]:   <uuid>4d156604-74f0-48ee-8fd8-8d4bad6b7a35</uuid>
Nov 08 15:57:16 user nova-compute[74788]:   <name>instance-00000033</name>
Nov 08 15:57:16 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 15:57:16 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 15:57:16 user nova-compute[74788]:   <metadata>
Nov 08 15:57:16 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 15:57:16 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 15:57:16 user nova-compute[74788]:       <nova:name>tempest-TestShelveInstance-server-140683081</nova:name>
Nov 08 15:57:16 user nova-compute[74788]:       <nova:creationTime>2023-11-08 15:57:14</nova:creationTime>
Nov 08 15:57:16 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 15:57:16 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 15:57:16 user nova-compute[74788]:       </nova:flavor>
Nov 08 15:57:16 user nova-compute[74788]:       <nova:owner>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:user uuid="6dcf0cfe564c46b7b010055cdd0dd6f2">tempest-TestShelveInstance-1817171713-project-member</nova:user>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:project uuid="6ad34415d349442d91bc7d6590ff00f4">tempest-TestShelveInstance-1817171713</nova:project>
Nov 08 15:57:16 user nova-compute[74788]:       </nova:owner>
Nov 08 15:57:16 user nova-compute[74788]:       <nova:ports>
Nov 08 15:57:16 user nova-compute[74788]:         <nova:port uuid="f8a2871c-bf0a-427e-9da1-d4abbf22499e">
Nov 08 15:57:16 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 15:57:16 user nova-compute[74788]:         </nova:port>
Nov 08 15:57:16 user nova-compute[74788]:       </nova:ports>
Nov 08 15:57:16 user nova-compute[74788]:     </nova:instance>
Nov 08 15:57:16 user nova-compute[74788]:   </metadata>
Nov 08 15:57:16 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 15:57:16 user nova-compute[74788]:     <system>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="serial">4d156604-74f0-48ee-8fd8-8d4bad6b7a35</entry>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="uuid">4d156604-74f0-48ee-8fd8-8d4bad6b7a35</entry>
Nov 08 15:57:16 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 15:57:16 user nova-compute[74788]:     </system>
Nov 08 15:57:16 user nova-compute[74788]:   </sysinfo>
Nov 08 15:57:16 user nova-compute[74788]:   <os>
Nov 08 15:57:16 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 15:57:16 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 15:57:16 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 15:57:16 user nova-compute[74788]:   </os>
Nov 08 15:57:16 user nova-compute[74788]:   <features>
Nov 08 15:57:16 user nova-compute[74788]:     <acpi/>
Nov 08 15:57:16 user nova-compute[74788]:     <apic/>
Nov 08 15:57:16 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 15:57:16 user nova-compute[74788]:   </features>
Nov 08 15:57:16 user nova-compute[74788]:   <clock offset="utc">
Nov 08 15:57:16 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 15:57:16 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 15:57:16 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 15:57:16 user nova-compute[74788]:   </clock>
Nov 08 15:57:16 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 15:57:16 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 15:57:16 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 15:57:16 user nova-compute[74788]:   </cpu>
Nov 08 15:57:16 user nova-compute[74788]:   <devices>
Nov 08 15:57:16 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 15:57:16 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:57:16 user nova-compute[74788]:       <source dev="/dev/sdd"/>
Nov 08 15:57:16 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 15:57:16 user nova-compute[74788]:       <serial>e7baf0b2-bb8c-4bb0-b9d1-80e759888122</serial>
Nov 08 15:57:16 user nova-compute[74788]:     </disk>
Nov 08 15:57:16 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 15:57:16 user nova-compute[74788]:       <mac address="fa:16:3e:30:01:0d"/>
Nov 08 15:57:16 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:57:16 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 15:57:16 user nova-compute[74788]:       <target dev="tapf8a2871c-bf"/>
Nov 08 15:57:16 user nova-compute[74788]:     </interface>
Nov 08 15:57:16 user nova-compute[74788]:     <serial type="pty">
Nov 08 15:57:16 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35/console.log" append="off"/>
Nov 08 15:57:16 user nova-compute[74788]:     </serial>
Nov 08 15:57:16 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 15:57:16 user nova-compute[74788]:     <video>
Nov 08 15:57:16 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 15:57:16 user nova-compute[74788]:     </video>
Nov 08 15:57:16 user nova-compute[74788]:     <rng model="virtio">
Nov 08 15:57:16 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 15:57:16 user nova-compute[74788]:     </rng>
Nov 08 15:57:16 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 15:57:16 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 15:57:16 user nova-compute[74788]:       <stats period="10"/>
Nov 08 15:57:16 user nova-compute[74788]:     </memballoon>
Nov 08 15:57:16 user nova-compute[74788]:   </devices>
Nov 08 15:57:16 user nova-compute[74788]: </domain>
Nov 08 15:57:16 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1337526013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:56:49Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG os_vif [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd39644e3-b27f-571b-873f-82c629e4d4dc', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8a2871c-bf, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8a2871c-bf, col_values=(('qos', UUID('80ddc66f-db0b-4897-a529-2dbcd4c4dd0e')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8a2871c-bf, col_values=(('external_ids', {'iface-id': 'f8a2871c-bf0a-427e-9da1-d4abbf22499e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:01:0d', 'vm-uuid': '4d156604-74f0-48ee-8fd8-8d4bad6b7a35'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:16 user nova-compute[74788]: INFO os_vif [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf')
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] No VIF found with MAC fa:16:3e:30:01:0d, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:17 user nova-compute[74788]: DEBUG nova.compute.manager [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:57:17 user nova-compute[74788]: WARNING nova.compute.manager [req-fda64051-602b-407d-b518-372f4998f8f2 req-44f60d9e-8b34-421b-8f5c-351c9791e0e7 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:57:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 15:57:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance spawned successfully.
Nov 08 15:57:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:19 user nova-compute[74788]: DEBUG nova.compute.manager [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:57:19 user nova-compute[74788]: WARNING nova.compute.manager [req-5dbd334b-5cbc-422e-9644-a57e24a4b603 req-cb56ac7f-bf1d-40ac-9b07-070d40216061 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 15:57:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-05cf38b9-173c-4a8b-807e-33d91b15077e tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.809s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:57:23 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:28 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:33 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 is timed out.
Nov 08 15:57:33 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config.
Nov 08 15:57:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZxhzisG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:57:33 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa26b79-4ea5-4676-97a7-90c4e6a3ecba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:57:33 user nova-compute[74788]: No targets found.
Nov 08 15:57:33 user nova-compute[74788]: iSNS:
Nov 08 15:57:33 user nova-compute[74788]: No targets found.
Nov 08 15:57:33 user nova-compute[74788]: STATIC:
Nov 08 15:57:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:57:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:57:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:57:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122
Nov 08 15:57:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:57:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:57:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36
Nov 08 15:57:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:57:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:57:33 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:57:33 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:57:33 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:57:33 user nova-compute[74788]: FIRMWARE:
Nov 08 15:57:33 user nova-compute[74788]: No targets found.
Nov 08 15:57:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:57:33 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:57:33 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7e45b-87f9-4119-a386-e17eec74abe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37dfd8-cd4b-46b1-b0ad-b1e30849078d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:57:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77583bf1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73bf1c4-ada5-4cd9-a953-3ab2a9d05fe9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82c7638-e2f0-4d38-a952-9dada0dc9250]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ef768b-45f5-48e6-a9f0-2ab08b7f5287]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5aa16-758a-4210-8752-e986c3486645]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cadf9f-f86f-4d9a-857e-3c19d32161bc]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.129s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[89865656-6f70-431b-9620-bed320380410]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260]
Nov 08 15:57:33 user nova-compute[74788]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36, portal: 172.16.0.220,3260] successful.
Nov 08 15:57:33 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d2cb54-f2fa-4899-9f82-b9bb37e1de36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b149c-875f-4abc-afa6-9c0731137248]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== disconnect_volume: return (368ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:57:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:34 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:57:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f2c69650-9f21-4834-bbc8-f7e59e822460 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:57:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:41 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:51 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:57:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:00 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:00 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 15:58:01 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:05 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:06 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:08 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:09 user nova-compute[74788]: INFO nova.compute.manager [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attaching volume 6aa5667a-1060-4ebd-a240-3b246bcb96c7 to /dev/vdb
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.utils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c798dd-2350-4c0a-86ef-2e820c07e688]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[db560df8-5c1b-4f3d-a7c6-fb3318f25f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a76707-7359-4787-b546-ee57b9534137]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a3e2f-7126-416f-bc99-cbef1f9a4387]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:58:09 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:58:09 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf91bc-ecd4-4190-87c6-d143aff9d4c0]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG os_brick.utils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:58:09 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating existing volume attachment record: 0bda617b-f5a0-4108-a9e5-1ee86b306c95 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:58:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:58:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:58:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=24.916473388671875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 15:58:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 15:58:13 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:58:13 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:58:13 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:58:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:13 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [{"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-350d485c-76fa-4afb-ab9f-0c8b26cd60d4" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:58:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:58:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 8cd25306-3d05-41d6-90f8-b537cc59a94c {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:31 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 15:58:32 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 15:58:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:58:38 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG nova.compute.manager [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing instance network info cache due to event network-changed-f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] Acquiring lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] Acquired lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:58:39 user nova-compute[74788]: DEBUG nova.network.neutron [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Refreshing network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:40 user nova-compute[74788]: INFO nova.compute.manager [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Terminating instance
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updated VIF entry in instance network info cache for port f8a2871c-bf0a-427e-9da1-d4abbf22499e. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.network.neutron [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [{"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-4e74b709-2b29-4c38-89a3-690b789acb0c req-797c887b-0d03-41fb-a89c-cf0e25d16a8a service nova] Releasing lock "refresh_cache-4d156604-74f0-48ee-8fd8-8d4bad6b7a35" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:58:40 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Instance destroyed successfully.
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lazy-loading 'resources' on Instance uuid 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T15:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-140683081',display_name='tempest-TestShelveInstance-server-140683081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-140683081',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemo86h1yXlN9WbZx3TL7vgJ4VVMR/1eHd89UbjL6P9NODl+HhlDXS326cJuW8EsM40KuvAj6peMMNRdQoMdUQnvKtPUiRL8TJqrFnwa6/L10mAJFNdwRme+2Jt27U8TA==',key_name='tempest-TestShelveInstance-1337526013',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:57:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ad34415d349442d91bc7d6590ff00f4',ramdisk_id='',reservation_id='r-ryarduli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1817171713',owner_user_name='tempest-TestShelveInstance-1817171713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:57:20Z,user_data=None,user_id='6dcf0cfe564c46b7b010055cdd0dd6f2',uuid=4d156604-74f0-48ee-8fd8-8d4bad6b7a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converting VIF {"id": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "address": "fa:16:3e:30:01:0d", "network": {"id": "ee024ccf-8749-4ef4-b7a5-4f10543e89db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307531335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ad34415d349442d91bc7d6590ff00f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8a2871c-bf", "ovs_interfaceid": "f8a2871c-bf0a-427e-9da1-d4abbf22499e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_vif [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8a2871c-bf, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80ddc66f-db0b-4897-a529-2dbcd4c4dd0e) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:40 user nova-compute[74788]: INFO os_vif [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=f8a2871c-bf0a-427e-9da1-d4abbf22499e,network=Network(ee024ccf-8749-4ef4-b7a5-4f10543e89db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8a2871c-bf')
Nov 08 15:58:40 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkrDfwHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:58:40 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c31464-cdea-4632-8752-9cbd59df2773]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:58:40 user nova-compute[74788]: No targets found.
Nov 08 15:58:40 user nova-compute[74788]: iSNS:
Nov 08 15:58:40 user nova-compute[74788]: No targets found.
Nov 08 15:58:40 user nova-compute[74788]: STATIC:
Nov 08 15:58:40 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:58:40 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:40 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:40 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122
Nov 08 15:58:40 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:40 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:40 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:58:40 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:40 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:40 user nova-compute[74788]: FIRMWARE:
Nov 08 15:58:40 user nova-compute[74788]: No targets found.
Nov 08 15:58:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:58:40 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:58:40 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[b973e4b2-399e-4403-b6a6-5d0cabc722f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[31656cdf-b393-4000-8954-5284d3947571]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:40 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:40 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:58:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:40 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:40 user nova-compute[74788]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 (non-flash)
Nov 08 15:58:40 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77970865f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122'): ({'sdd'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Removing single pathed devices sdd {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d45b70-75cf-47af-b263-d24aa1da9769]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f83f8b-aba7-4e85-a5e7-331e1303a4d1]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Flushing IO for device /dev/sdd {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e8ba89-7ce6-4c47-91b2-da34cc7be7a6]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:58:40 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedc3c3-932e-4e42-9b78-1de4234b2b02]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] SCSI volumes sdd have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb3257ea1-86efdb8123d0dc89', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b3257ea1', '/dev/disk/by-id/scsi-23836656664623831') {{(pid=85485) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f3b6e-731d-4aea-b41c-99a1e0f4ecbf]: (4, None) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca907d1-4313-43a7-8437-640e0ac48745]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978b462-6428-418d-8368-82027dfe8486]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260]
Nov 08 15:58:41 user nova-compute[74788]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122, portal: 172.16.0.220,3260] successful.
Nov 08 15:58:41 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7baf0b2-bb8c-4bb0-b9d1-80e759888122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ff37a-819e-46f3-954f-e2e12e00cf2e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] <== disconnect_volume: return (311ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:58:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deleting instance files /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35_del
Nov 08 15:58:41 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deletion of /opt/stack/data/nova/instances/4d156604-74f0-48ee-8fd8-8d4bad6b7a35_del complete
Nov 08 15:58:41 user nova-compute[74788]: INFO nova.compute.manager [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:58:41 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Took 0.47 seconds to deallocate network for instance.
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-8e97df02-0133-47cf-bd04-222148aee024 req-31ce30cc-0bcd-4c45-ad31-259f906a4956 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-deleted-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:41 user nova-compute[74788]: INFO nova.compute.manager [req-8e97df02-0133-47cf-bd04-222148aee024 req-31ce30cc-0bcd-4c45-ad31-259f906a4956 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Neutron deleted interface f8a2871c-bf0a-427e-9da1-d4abbf22499e; detaching it from the instance and deleting it from the info cache
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.network.neutron [req-8e97df02-0133-47cf-bd04-222148aee024 req-31ce30cc-0bcd-4c45-ad31-259f906a4956 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-8e97df02-0133-47cf-bd04-222148aee024 req-31ce30cc-0bcd-4c45-ad31-259f906a4956 service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Detach interface failed, port_id=f8a2871c-bf0a-427e-9da1-d4abbf22499e, reason: Instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-unplugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Acquiring lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:41 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] No waiting events found dispatching network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:58:42 user nova-compute[74788]: WARNING nova.compute.manager [req-7bca77c9-ccd8-41ec-a270-c0d2ebc8189f req-79075897-653b-4b73-9960-3a4e7a0ec62e service nova] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Received unexpected event network-vif-plugged-f8a2871c-bf0a-427e-9da1-d4abbf22499e for instance with vm_state active and task_state deleting.
Nov 08 15:58:42 user nova-compute[74788]: INFO nova.compute.manager [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Took 0.98 seconds to detach 1 volumes for instance.
Nov 08 15:58:42 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] [instance: 4d156604-74f0-48ee-8fd8-8d4bad6b7a35] Deleting volume: e7baf0b2-bb8c-4bb0-b9d1-80e759888122 {{(pid=74788) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbYpzmFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:58:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:58:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:58:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:58:42 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:58:42 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:58:43 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892808f-3c5a-41b1-85c6-d77dc0071256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 15:58:43 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a7e7b1-5f39-4617-875f-56b442644b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7] added
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a11c8-a8f8-4b5e-9a82-fd5df25fd912]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Deleted allocations for instance 4d156604-74f0-48ee-8fd8-8d4bad6b7a35
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4429c-a31b-4f79-a4e9-387a3f40582c]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbYpzmFt {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbYpzmFt" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9e6e5-8e4f-41cd-8c7a-961672a1e24f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbYpzmFt'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba3b2a9-9457-4e5c-8a4c-6fae69ca9977]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[86101870-043b-47e0-97b8-4dd96f88d633]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f133213d-c5c1-4bd4-9114-672531884a31 tempest-TestShelveInstance-1817171713 tempest-TestShelveInstance-1817171713-project-member] Lock "4d156604-74f0-48ee-8fd8-8d4bad6b7a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.204s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[029736ff-a4e2-4deb-bea7-dbdc154eb287]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260]
Nov 08 15:58:43 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260] successful.
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06c0aa0-394b-4ad8-bfb7-e811520b0207]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e7ca0e-f90c-40ef-8d8a-0b83c861f942]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:43 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:58:43 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88984f-1b19-4fd0-81e5-88c0c0a488c5]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:43 user nova-compute[74788]: INFO nova.compute.manager [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Terminating instance
Nov 08 15:58:43 user nova-compute[74788]: DEBUG nova.compute.manager [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG nova.compute.manager [req-0ed49715-87dd-4dab-aea6-c735198db302 req-1e646431-2051-4722-b351-b3417c5368e8 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-unplugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:58:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Instance destroyed successfully.
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid 350d485c-76fa-4afb-ab9f-0c8b26cd60d4 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbYpzmFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23562333338356632', 'path': '/dev/sdc'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562333338356632', 'path': '/dev/sdc'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.objects.instance [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1206809306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1206809306',id=49,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ihwmtdbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:56:58Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=350d485c-76fa-4afb-ab9f-0c8b26cd60d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "address": "fa:16:3e:c5:cb:19", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f68dd32-fc", "ovs_interfaceid": "7f68dd32-fce9-4fcb-836e-b6dae2626762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_vif [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f68dd32-fc, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eac4c290-e5ab-4daf-9171-f240395c7b54) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:44 user nova-compute[74788]: INFO os_vif [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:cb:19,bridge_name='br-int',has_traffic_filtering=True,id=7f68dd32-fce9-4fcb-836e-b6dae2626762,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f68dd32-fc')
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 15:58:44 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:58:44 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:58:44 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:58:44 user nova-compute[74788]:   <serial>6aa5667a-1060-4ebd-a240-3b246bcb96c7</serial>
Nov 08 15:58:44 user nova-compute[74788]: </disk>
Nov 08 15:58:44 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPlQaJsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:58:44 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd05152-0c25-47bd-8d04-244d8f348475]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:58:44 user nova-compute[74788]: No targets found.
Nov 08 15:58:44 user nova-compute[74788]: iSNS:
Nov 08 15:58:44 user nova-compute[74788]: No targets found.
Nov 08 15:58:44 user nova-compute[74788]: STATIC:
Nov 08 15:58:44 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc
Nov 08 15:58:44 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:44 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:44 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:58:44 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:44 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:44 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7
Nov 08 15:58:44 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:58:44 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:58:44 user nova-compute[74788]: FIRMWARE:
Nov 08 15:58:44 user nova-compute[74788]: No targets found.
Nov 08 15:58:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:58:44 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:58:44 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d63dd9-2c1f-46aa-9c47-0e8a6b59b96f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[10141635-e177-47e7-bfc3-817df4491f9b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:44 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:44 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:58:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:58:44 user nova-compute[74788]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc (non-flash)
Nov 08 15:58:44 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:58:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c4d1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d94c4d-e899-4ba6-8c6d-e6bfad9396ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119f7f5-99e9-4a92-92e2-d1655b9aa05d]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[478b33d2-c140-4cd4-b82f-da2ac3a2c0d9]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b989b61-c7a2-4ee2-9ec5-33d566067962]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966ecee-f6c6-4b26-bce8-ce5411cd2457]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4704544-f500-461b-9d3c-e855b51a46f8]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260]
Nov 08 15:58:44 user nova-compute[74788]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc, portal: 172.16.0.220,3260] successful.
Nov 08 15:58:44 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f7c9602-16de-4455-b85e-5311a3b415fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac030e3-5cf9-47e7-b33b-7a57525f4cbc]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== disconnect_volume: return (354ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:58:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Deleting instance files /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4_del
Nov 08 15:58:44 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Deletion of /opt/stack/data/nova/instances/350d485c-76fa-4afb-ab9f-0c8b26cd60d4_del complete
Nov 08 15:58:44 user nova-compute[74788]: INFO nova.compute.manager [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 08 15:58:44 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 15:58:44 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No VIF found with MAC fa:16:3e:4d:78:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-3b880b0c-e591-4df4-b0ed-ffdad1b1e155 tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.898s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.865s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:58:45 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Took 0.42 seconds to deallocate network for instance.
Nov 08 15:58:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-6fdb13e2-3935-4a7a-b238-d44969b276a8 req-b614ed89-f395-4fbd-ab55-5b1d110d653d service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-deleted-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] Acquiring lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:45 user nova-compute[74788]: DEBUG nova.compute.manager [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] No waiting events found dispatching network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:58:45 user nova-compute[74788]: WARNING nova.compute.manager [req-c80cbff6-2c0d-4db0-9aef-425649453fe0 req-89f645cb-0823-442d-90bf-301e409f6819 service nova] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Received unexpected event network-vif-plugged-7f68dd32-fce9-4fcb-836e-b6dae2626762 for instance with vm_state active and task_state deleting.
Nov 08 15:58:46 user nova-compute[74788]: INFO nova.compute.manager [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 350d485c-76fa-4afb-ab9f-0c8b26cd60d4] Took 1.09 seconds to detach 1 volumes for instance.
Nov 08 15:58:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:58:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:58:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:46 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Deleted allocations for instance 350d485c-76fa-4afb-ab9f-0c8b26cd60d4
Nov 08 15:58:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-b6848ede-985a-4667-ba28-ed816bce27f5 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "350d485c-76fa-4afb-ab9f-0c8b26cd60d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:58:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:58:47 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:58:47 user nova-compute[74788]: INFO nova.compute.manager [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Detaching volume 6aa5667a-1060-4ebd-a240-3b246bcb96c7
Nov 08 15:58:47 user nova-compute[74788]: INFO nova.virt.block_device [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attempting to driver detach volume 6aa5667a-1060-4ebd-a240-3b246bcb96c7 from mountpoint /dev/vdb
Nov 08 15:58:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Attempting to detach device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 15:58:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:58:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:58:47 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:58:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:58:47 user nova-compute[74788]:   <serial>6aa5667a-1060-4ebd-a240-3b246bcb96c7</serial>
Nov 08 15:58:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:58:47 user nova-compute[74788]: </disk>
Nov 08 15:58:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:58:47 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config.
Nov 08 15:58:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 15:58:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 15:58:47 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 15:58:47 user nova-compute[74788]:   <source dev="/dev/sdc"/>
Nov 08 15:58:47 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 15:58:47 user nova-compute[74788]:   <serial>6aa5667a-1060-4ebd-a240-3b246bcb96c7</serial>
Nov 08 15:58:47 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 15:58:47 user nova-compute[74788]: </disk>
Nov 08 15:58:47 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 15:58:47 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 15:58:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:58:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:58:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:07 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 is timed out.
Nov 08 15:59:07 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config.
Nov 08 15:59:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbYpzmFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:59:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f00c2-b4a3-44e5-a6cd-4f23c26aa38d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 15:59:07 user nova-compute[74788]: No targets found.
Nov 08 15:59:07 user nova-compute[74788]: iSNS:
Nov 08 15:59:07 user nova-compute[74788]: No targets found.
Nov 08 15:59:07 user nova-compute[74788]: STATIC:
Nov 08 15:59:07 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 15:59:07 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:59:07 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:59:07 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7
Nov 08 15:59:07 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 15:59:07 user nova-compute[74788]:                 Iface Name: default
Nov 08 15:59:07 user nova-compute[74788]: FIRMWARE:
Nov 08 15:59:07 user nova-compute[74788]: No targets found.
Nov 08 15:59:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 15:59:07 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 15:59:07 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce318594-781f-4c3e-b899-a08e44bed7ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498ab6a-695c-4636-9566-3016874c945e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:59:07 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:59:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 15:59:07 user nova-compute[74788]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 (non-flash)
Nov 08 15:59:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7758581ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7'): ({'sdc'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Removing single pathed devices sdc {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c45a88-598e-4cd2-b014-010cb24dca6e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b5545a-ddcd-40d6-ac68-3f16251ecdd1]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flushing IO for device /dev/sdc {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ef87b-23f5-45cf-a3bb-71c29dd9ac2e]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cabe9a9-a521-4089-b55f-5b76ac08b7db]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] SCSI volumes sdc have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f80e7-bd2f-4a5f-8e0a-4d439f3120ca]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:59:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab8ca1-4f52-4d00-a6c5-68c7e7edefeb]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260]
Nov 08 15:59:08 user nova-compute[74788]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7, portal: 172.16.0.220,3260] successful.
Nov 08 15:59:08 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa5667a-1060-4ebd-a240-3b246bcb96c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06de85-0223-4f0c-8c33-38595f46f1a5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== disconnect_volume: return (279ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:59:08 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-4e56be34-c58e-4119-8543-604583470f4d tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:59:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:10 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:10 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:11 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:59:12 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=24.914932250976562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 8cd25306-3d05-41d6-90f8-b537cc59a94c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 15:59:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 15:59:13 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 15:59:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:59:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 15:59:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 15:59:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:18 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 15:59:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 15:59:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:33 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:34 user nova-compute[74788]: INFO nova.compute.manager [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Terminating instance
Nov 08 15:59:34 user nova-compute[74788]: DEBUG nova.compute.manager [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-unplugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] No waiting events found dispatching network-vif-unplugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:59:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-684b2ee2-863f-439f-8c3c-10acaa544208 req-33cb5ef0-b0a5-4c2c-b26b-429421546ade service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-unplugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 15:59:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Instance destroyed successfully.
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.objects.instance [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid 8cd25306-3d05-41d6-90f8-b537cc59a94c {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-874417440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-874417440',id=48,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ixp20n0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:51:18Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=8cd25306-3d05-41d6-90f8-b537cc59a94c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "address": "fa:16:3e:7c:a1:9a", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53c5dd7-4a", "ovs_interfaceid": "a53c5dd7-4ad6-48d1-99c7-a9cb869f578b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG os_vif [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53c5dd7-4a, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87b1f994-360d-41f6-a026-c1e6878a6b25) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 15:59:35 user nova-compute[74788]: INFO os_vif [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:9a,bridge_name='br-int',has_traffic_filtering=True,id=a53c5dd7-4ad6-48d1-99c7-a9cb869f578b,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53c5dd7-4a')
Nov 08 15:59:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Deleting instance files /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c_del
Nov 08 15:59:35 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Deletion of /opt/stack/data/nova/instances/8cd25306-3d05-41d6-90f8-b537cc59a94c_del complete
Nov 08 15:59:35 user nova-compute[74788]: INFO nova.compute.manager [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 08 15:59:35 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 15:59:35 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Took 0.86 seconds to deallocate network for instance.
Nov 08 15:59:35 user nova-compute[74788]: DEBUG nova.compute.manager [req-dece0a5f-9557-4258-920c-e33376cb15b1 req-14f01335-638c-43f3-a499-5f97bf89acec service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-deleted-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:36 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Deleted allocations for instance 8cd25306-3d05-41d6-90f8-b537cc59a94c
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-0f697478-554f-49f7-81e3-9dd455f68fa1 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] Acquiring lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] Lock "8cd25306-3d05-41d6-90f8-b537cc59a94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] No waiting events found dispatching network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 15:59:36 user nova-compute[74788]: WARNING nova.compute.manager [req-5871cce9-4240-4f8f-8125-823edfc7a11e req-d87eed01-1c64-413c-9ff3-1ea58de58dab service nova] [instance: 8cd25306-3d05-41d6-90f8-b537cc59a94c] Received unexpected event network-vif-plugged-a53c5dd7-4ad6-48d1-99c7-a9cb869f578b for instance with vm_state deleted and task_state None.
Nov 08 15:59:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG nova.objects.instance [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 15:59:43 user nova-compute[74788]: INFO nova.compute.manager [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attaching volume 7872a772-25e7-4315-85a0-f3b543967e2a to /dev/vdb
Nov 08 15:59:43 user nova-compute[74788]: DEBUG os_brick.utils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[80499f7a-5113-4f60-8d3d-3559b0319bc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7817ceb9-fa4b-4de5-94c8-ffdb08834897]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae308b-d471-4b22-8263-ae6cca625a4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae24186-cf42-4f19-9ca4-e0066b556dc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:43 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 15:59:44 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 15:59:44 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[346410ca-bc7c-4473-9146-50a223601bd4]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG os_brick.utils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 15:59:44 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating existing volume attachment record: 1686afef-9809-4f67-80c4-e10c6acb22b9 {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 15:59:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 15:59:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLhQGZAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:00:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:00:07 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:00:07 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c578c38b-f52e-4bdc-8d48-3dfd418fb1cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:00:07 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f9456-7614-4341-a4eb-b3573662bbcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a] added
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba66ae5f-6d02-4615-831b-a58c82933d1b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc6907-baeb-41f1-b043-76edc16e1a6d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLhQGZAy {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLhQGZAy" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb867f8-87e4-4e49-a901-fd07ceee03ff]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLhQGZAy'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a162afc7-da8b-44b3-88d8-c66a0765837b]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0329285-01af-45a7-affc-5c4dd7e6b85a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f146b59-c5d0-4e45-8c99-40e3db795031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260]
Nov 08 16:00:07 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260] successful.
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b409d7f-d15f-46a3-8793-3f36a0cc1a1f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11693c-17ea-4edd-955e-4fe2388d38e9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:07 user nova-compute[74788]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:07 user nova-compute[74788]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:07 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3a6cb-9a4e-46e7-b711-9590c5a1a922]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLhQGZAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:00:07 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:00:08 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26132643866323864', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:00:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132643866323864', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:00:08 user nova-compute[74788]: DEBUG nova.objects.instance [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:00:08 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:00:08 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:00:08 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:00:08 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:00:08 user nova-compute[74788]:   <serial>7872a772-25e7-4315-85a0-f3b543967e2a</serial>
Nov 08 16:00:08 user nova-compute[74788]: </disk>
Nov 08 16:00:08 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:00:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:00:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:00:09 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] No VIF found with MAC fa:16:3e:4d:78:5c, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:00:09 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-587561b5-4929-4c2c-bf46-e0ee1474223b tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.338s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:11 user nova-compute[74788]: INFO nova.compute.manager [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Detaching volume 7872a772-25e7-4315-85a0-f3b543967e2a
Nov 08 16:00:11 user nova-compute[74788]: INFO nova.virt.block_device [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Attempting to driver detach volume 7872a772-25e7-4315-85a0-f3b543967e2a from mountpoint /dev/vdb
Nov 08 16:00:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Attempting to detach device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:00:11 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:00:11 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:00:11 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:00:11 user nova-compute[74788]:   <serial>7872a772-25e7-4315-85a0-f3b543967e2a</serial>
Nov 08 16:00:11 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:00:11 user nova-compute[74788]: </disk>
Nov 08 16:00:11 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:00:11 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the persistent domain config.
Nov 08 16:00:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:00:11 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:00:11 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:00:11 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:00:11 user nova-compute[74788]:   <serial>7872a772-25e7-4315-85a0-f3b543967e2a</serial>
Nov 08 16:00:11 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:00:11 user nova-compute[74788]: </disk>
Nov 08 16:00:11 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:00:11 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:12 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:13 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:00:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.037994384765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:00:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:00:15 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [{"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:00:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-149d3800-34cd-479c-9f6c-626743b00fbe" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:00:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:00:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:00:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:24 user nova-compute[74788]: INFO nova.compute.manager [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Terminating instance
Nov 08 16:00:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-3124a923-2247-4365-9299-ef7ba10618d2 req-76e91d38-a44f-4c72-a053-b008085c7911 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-unplugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Instance destroyed successfully.
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.objects.instance [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid ebeaebbb-acd5-4f72-9b11-d81d85eca41f {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-399064259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-399064259',id=45,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-ssvoti8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:47:34Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=ebeaebbb-acd5-4f72-9b11-d81d85eca41f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "address": "fa:16:3e:70:c0:88", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19755a1e-b2", "ovs_interfaceid": "19755a1e-b211-471d-b8ba-42d4e663ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_vif [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19755a1e-b2, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22cdcab3-73ae-4dd1-89f0-473cc69bd5db) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:25 user nova-compute[74788]: INFO os_vif [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c0:88,bridge_name='br-int',has_traffic_filtering=True,id=19755a1e-b211-471d-b8ba-42d4e663ca6a,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19755a1e-b2')
Nov 08 16:00:25 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhDMmeus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:00:25 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[476dc9a6-907e-4de9-94bc-e6246bdcbfd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:00:25 user nova-compute[74788]: No targets found.
Nov 08 16:00:25 user nova-compute[74788]: iSNS:
Nov 08 16:00:25 user nova-compute[74788]: No targets found.
Nov 08 16:00:25 user nova-compute[74788]: STATIC:
Nov 08 16:00:25 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959
Nov 08 16:00:25 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:00:25 user nova-compute[74788]:                 Iface Name: default
Nov 08 16:00:25 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a
Nov 08 16:00:25 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:00:25 user nova-compute[74788]:                 Iface Name: default
Nov 08 16:00:25 user nova-compute[74788]: FIRMWARE:
Nov 08 16:00:25 user nova-compute[74788]: No targets found.
Nov 08 16:00:25 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:00:25 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:00:25 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a071825-9957-4378-b48d-24fd3a8d1b4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c74e9a-6a0b-4743-9649-ef7c5ffd010f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:25 user nova-compute[74788]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:25 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 (non-flash)
Nov 08 16:00:25 user nova-compute[74788]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:25 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77585024d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959'): ({'sde'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Removing single pathed devices sde {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d61245-48fa-4c7d-9145-6102d0b7186f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa616e-7394-4f33-ac88-038a24b1bb2a]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Flushing IO for device /dev/sde {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e9a566-36d0-4539-bc97-38e615df9084]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f48de47-a871-4c92-a940-3f07bbfd8b3e]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] SCSI volumes sde have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[480fec8a-3b63-4dfe-be72-c0eb5db7eff0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:25 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[056647e9-ab89-4a85-8f71-a0300b77aa41]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260]
Nov 08 16:00:26 user nova-compute[74788]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959, portal: 172.16.0.220,3260] successful.
Nov 08 16:00:26 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469c5642-1a5b-4433-8cc7-5eb379463959 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db8046-ceca-4134-9ed5-9d731aa16779]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] <== disconnect_volume: return (291ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:00:26 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Deleting instance files /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f_del
Nov 08 16:00:26 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Deletion of /opt/stack/data/nova/instances/ebeaebbb-acd5-4f72-9b11-d81d85eca41f_del complete
Nov 08 16:00:26 user nova-compute[74788]: INFO nova.compute.manager [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 16:00:26 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:00:26 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:00:26 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Took 0.48 seconds to deallocate network for instance.
Nov 08 16:00:26 user nova-compute[74788]: DEBUG nova.compute.manager [req-3a59679d-c0ae-4771-9e00-d369e1ecdb53 req-13a3f779-5258-4c4e-b653-dbc5386ce055 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-deleted-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] Acquiring lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] No waiting events found dispatching network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:00:27 user nova-compute[74788]: WARNING nova.compute.manager [req-0405ff6e-745b-4391-8d9e-fd2d8dabfb05 req-9b8a0985-56c4-449d-8ed0-2509ae9ec6f2 service nova] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Received unexpected event network-vif-plugged-19755a1e-b211-471d-b8ba-42d4e663ca6a for instance with vm_state active and task_state deleting.
Nov 08 16:00:27 user nova-compute[74788]: INFO nova.compute.manager [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: ebeaebbb-acd5-4f72-9b11-d81d85eca41f] Took 1.17 seconds to detach 1 volumes for instance.
Nov 08 16:00:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:00:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:00:28 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:00:28 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:00:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:28 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Deleted allocations for instance ebeaebbb-acd5-4f72-9b11-d81d85eca41f
Nov 08 16:00:28 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-9ad9e271-33e3-44e2-adea-f9e1f7cc4974 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "ebeaebbb-acd5-4f72-9b11-d81d85eca41f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:00:31 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 is timed out.
Nov 08 16:00:31 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully detached device vdb from instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 from the live domain config.
Nov 08 16:00:31 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLhQGZAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:00:31 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e36e0-1f6f-4f7f-a6f1-a4a1a0f91657]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:00:31 user nova-compute[74788]: No targets found.
Nov 08 16:00:31 user nova-compute[74788]: iSNS:
Nov 08 16:00:31 user nova-compute[74788]: No targets found.
Nov 08 16:00:31 user nova-compute[74788]: STATIC:
Nov 08 16:00:31 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a
Nov 08 16:00:31 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:00:31 user nova-compute[74788]:                 Iface Name: default
Nov 08 16:00:31 user nova-compute[74788]: FIRMWARE:
Nov 08 16:00:31 user nova-compute[74788]: No targets found.
Nov 08 16:00:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:00:31 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:00:31 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142ecdd-1053-474e-bf6b-07308830a8ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a12aa-82a6-4f28-9417-5ebd5dc28931]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a (non-flash)
Nov 08 16:00:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c215900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[65acabd2-a01a-41aa-a67b-e73b87f20b3c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b225017-c477-4d71-bda0-af1de7b1e30b]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3e8875-8c96-4c21-be9a-058d220076d4]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88fe93a-1c12-4aca-8ece-dff95a3ad738]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e637d0a-3258-4352-89c9-1c03bb2e5a98]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d783c674-061e-4e24-aa90-46b04dc38e00]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260]
Nov 08 16:00:31 user nova-compute[74788]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a, portal: 172.16.0.220,3260] successful.
Nov 08 16:00:31 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7872a772-25e7-4315-85a0-f3b543967e2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051f1d3-ba95-4720-8be9-669459770348]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] <== disconnect_volume: return (287ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:00:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:00:33 user nova-compute[74788]: DEBUG nova.objects.instance [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'flavor' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:00:33 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-cafafd03-da85-4275-a8f7-3ae19837320c tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.939s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:00:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:00:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:00:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:13 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:14 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:01:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:16 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:01:16 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.036243438720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:16 user nova-compute[74788]: INFO nova.compute.manager [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Terminating instance
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 149d3800-34cd-479c-9f6c-626743b00fbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-unplugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] No waiting events found dispatching network-vif-unplugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:01:16 user nova-compute[74788]: DEBUG nova.compute.manager [req-d851f890-695c-4374-b677-e549d7d752d5 req-ca793c6d-fef2-4571-a4ae-9e8eea83d1f0 service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-unplugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:01:17 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Instance destroyed successfully.
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.objects.instance [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lazy-loading 'resources' on Instance uuid 149d3800-34cd-479c-9f6c-626743b00fbe {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-189805868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-189805868',id=42,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6442811e582464cb1edd2a82d930bac',ramdisk_id='',reservation_id='r-0t5uqfb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:42:46Z,user_data=None,user_id='8015e2645eac4fefb444c80dd1922ef2',uuid=149d3800-34cd-479c-9f6c-626743b00fbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converting VIF {"id": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "address": "fa:16:3e:76:26:bc", "network": {"id": "2213c6a7-1e86-43e0-8836-0d287bf819ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1924476530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6442811e582464cb1edd2a82d930bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf2ae3f-bc", "ovs_interfaceid": "2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG os_vif [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf2ae3f-bc, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b58c7c9-3a63-4aa7-858d-5fd4fd09f8a6) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:17 user nova-compute[74788]: INFO os_vif [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:26:bc,bridge_name='br-int',has_traffic_filtering=True,id=2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda,network=Network(2213c6a7-1e86-43e0-8836-0d287bf819ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf2ae3f-bc')
Nov 08 16:01:17 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Deleting instance files /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe_del
Nov 08 16:01:17 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Deletion of /opt/stack/data/nova/instances/149d3800-34cd-479c-9f6c-626743b00fbe_del complete
Nov 08 16:01:17 user nova-compute[74788]: INFO nova.compute.manager [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 16:01:17 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:01:17 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:01:18 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Took 1.05 seconds to deallocate network for instance.
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.compute.manager [req-f7fa663e-c877-4e50-a3c1-de7103231185 req-d5f81881-af47-422a-bbbd-b9bd05032ebb service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-deleted-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:18 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Deleted allocations for instance 149d3800-34cd-479c-9f6c-626743b00fbe
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-650ec636-4014-4ef8-9578-9c30a42e4981 tempest-ServerBootFromVolumeStableRescueTest-1899251386 tempest-ServerBootFromVolumeStableRescueTest-1899251386-project-member] Lock "149d3800-34cd-479c-9f6c-626743b00fbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.compute.manager [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] Acquiring lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] Lock "149d3800-34cd-479c-9f6c-626743b00fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:01:18 user nova-compute[74788]: DEBUG nova.compute.manager [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] No waiting events found dispatching network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:01:18 user nova-compute[74788]: WARNING nova.compute.manager [req-d5dff88f-0f59-4b2a-ab8e-98449393be88 req-631c045e-4b86-4b7a-91a0-1d9d70d4faaf service nova] [instance: 149d3800-34cd-479c-9f6c-626743b00fbe] Received unexpected event network-vif-plugged-2cf2ae3f-bcf5-4433-80cd-6a00a4f8ebda for instance with vm_state deleted and task_state None.
Nov 08 16:01:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:01:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:01:27 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:01:32 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:37 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:42 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:47 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:01:52 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:01:57 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:02 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:07 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:08 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:12 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:02:15 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [{"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:02:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.151683807373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:02:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:18 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:19 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Starting instance... {{(pid=74788) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74788) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:02:21 user nova-compute[74788]: INFO nova.compute.claims [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Claim successful on node user
Nov 08 16:02:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start building networks asynchronously for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Allocating IP information in the background. {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] allocate_for_instance() {{(pid=74788) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:02:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start building block device mappings for instance. {{(pid=74788) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.policy [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f03829e3fc6437e9de435d9e5e0eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a92f409c22c42e1a5d2c9936a3283fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74788) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start spawning the instance on the hypervisor. {{(pid=74788) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Creating instance directory {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:02:22 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Creating image(s)
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "a66e0460467b456d73d643debf3dc17b009b5dc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk 1073741824" returned: 0 in 0.048s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "a66e0460467b456d73d643debf3dc17b009b5dc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.279s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk. size=1073741824 {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:02:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Successfully created port: 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.virt.disk.api [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Cannot resize image /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk to a smaller size. {{(pid=74788) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Ensure instance console log exists: /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/console.log {{(pid=74788) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Successfully updated port: 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.compute.manager [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing instance network info cache due to event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance cache missing network info. {{(pid=74788) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance network_info: |[{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74788) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.network.neutron [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:02:23 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start _get_guest_xml network_info=[{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:02:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:02:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-989647765',display_name='tempest-ServerStableDeviceRescueTest-server-989647765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-989647765',id=52,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPJac6zd2bp6B5NSkp5cyi/JJoqzzJySFvGC67hME367sz3oWpc0RdiQUUWPfyVdhJewOouOT/VWtgJeEz9AJPOUOkDQlSemJG6qWji62fSRqba3YTrn5oe/xpIG9LdOQ==',key_name='tempest-keypair-1968090045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a92f409c22c42e1a5d2c9936a3283fc',ramdisk_id='',reservation_id='r-w6r3muki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2108142585',owner_user_name='tempest-ServerStableDeviceRescueTest-2108142585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f03829e3fc6437e9de435d9e5e0eb1c',uuid=581a3170-8e2b-4e7e-80d5-0dceb137c685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converting VIF {"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.objects.instance [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'pci_devices' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:02:24 user nova-compute[74788]:   <uuid>581a3170-8e2b-4e7e-80d5-0dceb137c685</uuid>
Nov 08 16:02:24 user nova-compute[74788]:   <name>instance-00000034</name>
Nov 08 16:02:24 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 16:02:24 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 16:02:24 user nova-compute[74788]:   <metadata>
Nov 08 16:02:24 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:02:24 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-989647765</nova:name>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:creationTime>2023-11-08 16:02:23</nova:creationTime>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 16:02:24 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:02:24 user nova-compute[74788]:       </nova:flavor>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:owner>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:user uuid="9f03829e3fc6437e9de435d9e5e0eb1c">tempest-ServerStableDeviceRescueTest-2108142585-project-member</nova:user>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:project uuid="9a92f409c22c42e1a5d2c9936a3283fc">tempest-ServerStableDeviceRescueTest-2108142585</nova:project>
Nov 08 16:02:24 user nova-compute[74788]:       </nova:owner>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 16:02:24 user nova-compute[74788]:       <nova:ports>
Nov 08 16:02:24 user nova-compute[74788]:         <nova:port uuid="29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4">
Nov 08 16:02:24 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 16:02:24 user nova-compute[74788]:         </nova:port>
Nov 08 16:02:24 user nova-compute[74788]:       </nova:ports>
Nov 08 16:02:24 user nova-compute[74788]:     </nova:instance>
Nov 08 16:02:24 user nova-compute[74788]:   </metadata>
Nov 08 16:02:24 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 16:02:24 user nova-compute[74788]:     <system>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="serial">581a3170-8e2b-4e7e-80d5-0dceb137c685</entry>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="uuid">581a3170-8e2b-4e7e-80d5-0dceb137c685</entry>
Nov 08 16:02:24 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:02:24 user nova-compute[74788]:     </system>
Nov 08 16:02:24 user nova-compute[74788]:   </sysinfo>
Nov 08 16:02:24 user nova-compute[74788]:   <os>
Nov 08 16:02:24 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:02:24 user nova-compute[74788]:     <boot dev="hd"/>
Nov 08 16:02:24 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 16:02:24 user nova-compute[74788]:   </os>
Nov 08 16:02:24 user nova-compute[74788]:   <features>
Nov 08 16:02:24 user nova-compute[74788]:     <acpi/>
Nov 08 16:02:24 user nova-compute[74788]:     <apic/>
Nov 08 16:02:24 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 16:02:24 user nova-compute[74788]:   </features>
Nov 08 16:02:24 user nova-compute[74788]:   <clock offset="utc">
Nov 08 16:02:24 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:02:24 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:02:24 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 16:02:24 user nova-compute[74788]:   </clock>
Nov 08 16:02:24 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 16:02:24 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 16:02:24 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:02:24 user nova-compute[74788]:   </cpu>
Nov 08 16:02:24 user nova-compute[74788]:   <devices>
Nov 08 16:02:24 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 16:02:24 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:02:24 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk"/>
Nov 08 16:02:24 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 16:02:24 user nova-compute[74788]:     </disk>
Nov 08 16:02:24 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 16:02:24 user nova-compute[74788]:       <mac address="fa:16:3e:6b:b6:39"/>
Nov 08 16:02:24 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 16:02:24 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 16:02:24 user nova-compute[74788]:       <target dev="tap29a74c9c-d4"/>
Nov 08 16:02:24 user nova-compute[74788]:     </interface>
Nov 08 16:02:24 user nova-compute[74788]:     <serial type="pty">
Nov 08 16:02:24 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/console.log" append="off"/>
Nov 08 16:02:24 user nova-compute[74788]:     </serial>
Nov 08 16:02:24 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:02:24 user nova-compute[74788]:     <video>
Nov 08 16:02:24 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 16:02:24 user nova-compute[74788]:     </video>
Nov 08 16:02:24 user nova-compute[74788]:     <rng model="virtio">
Nov 08 16:02:24 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:02:24 user nova-compute[74788]:     </rng>
Nov 08 16:02:24 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:02:24 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 16:02:24 user nova-compute[74788]:       <stats period="10"/>
Nov 08 16:02:24 user nova-compute[74788]:     </memballoon>
Nov 08 16:02:24 user nova-compute[74788]:   </devices>
Nov 08 16:02:24 user nova-compute[74788]: </domain>
Nov 08 16:02:24 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-989647765',display_name='tempest-ServerStableDeviceRescueTest-server-989647765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-989647765',id=52,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPJac6zd2bp6B5NSkp5cyi/JJoqzzJySFvGC67hME367sz3oWpc0RdiQUUWPfyVdhJewOouOT/VWtgJeEz9AJPOUOkDQlSemJG6qWji62fSRqba3YTrn5oe/xpIG9LdOQ==',key_name='tempest-keypair-1968090045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a92f409c22c42e1a5d2c9936a3283fc',ramdisk_id='',reservation_id='r-w6r3muki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2108142585',owner_user_name='tempest-ServerStableDeviceRescueTest-2108142585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f03829e3fc6437e9de435d9e5e0eb1c',uuid=581a3170-8e2b-4e7e-80d5-0dceb137c685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converting VIF {"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG os_vif [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1f160f7-5b3b-54b5-baf1-3ba720f3322a', '_type': 'linux-noop'}}, row=False) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29a74c9c-d4, may_exist=True, interface_attrs={}) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29a74c9c-d4, col_values=(('qos', UUID('0c502e7d-66f3-4555-b7ea-6e431f6e13e4')),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29a74c9c-d4, col_values=(('external_ids', {'iface-id': '29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:b6:39', 'vm-uuid': '581a3170-8e2b-4e7e-80d5-0dceb137c685'}),), if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:24 user nova-compute[74788]: INFO os_vif [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4')
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No VIF found with MAC fa:16:3e:6b:b6:39, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated VIF entry in instance network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG nova.network.neutron [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:02:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a11439b0-1a43-49ec-9f72-c798138c1ec6 req-6f91e9e9-f050-4aac-836c-4e7f352441d1 service nova] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:02:25 user nova-compute[74788]: WARNING nova.compute.manager [req-d76a989b-fe90-49cb-a899-d15912cca6da req-b4910b4c-ac6e-4b05-b0a9-e890fa557932 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state building and task_state spawning.
Nov 08 16:02:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance event wait completed in 0 seconds for  {{(pid=74788) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Guest created on hypervisor {{(pid=74788) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:02:27 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance spawned successfully.
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_cdrom_bus of ide {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_disk_bus of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_input_bus of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_pointer_model of None {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_video_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Found default for hw_vif_model of virtio {{(pid=74788) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:02:27 user nova-compute[74788]: INFO nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:27 user nova-compute[74788]: DEBUG nova.compute.manager [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:02:27 user nova-compute[74788]: WARNING nova.compute.manager [req-78372d96-fb45-4639-98fd-6f50544cbfdc req-84893a6d-c2b0-42eb-8671-623f8f1e567f service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state building and task_state spawning.
Nov 08 16:02:27 user nova-compute[74788]: INFO nova.compute.manager [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Took 5.89 seconds to build instance.
Nov 08 16:02:27 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-91ce8033-00be-43cf-96e4-05e5921b14c9 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.017s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:02:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:58 user nova-compute[74788]: INFO nova.compute.manager [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Terminating instance
Nov 08 16:02:58 user nova-compute[74788]: DEBUG nova.compute.manager [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:58 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-unplugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] No waiting events found dispatching network-vif-unplugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.compute.manager [req-aa5947e0-b8c3-40c5-b11a-6f1d98a6a2db req-40742dbd-d3d2-4248-86fe-edca6e5be602 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-unplugged-51589533-181b-4af7-a188-5780843f2a66 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Instance destroyed successfully.
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.objects.instance [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lazy-loading 'resources' on Instance uuid ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T15:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266898929',display_name='tempest-SnapshotDataIntegrityTests-server-266898929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266898929',id=50,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPNxg2/14LhD8CA+yAs64juG3u+dnQxGpTeiOsbKNZYZg6OR3HRpt0n6xwGRQx8ZConYKht1gqpVam9nhrULkimEJ2uowPChgggBJcT+p1VePQT787VpBvsC8hKzcUSZg==',key_name='tempest-keypair-248206686',keypairs=<?>,launch_index=0,launched_at=2023-11-08T15:52:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38f471aa860a48c1be9521823c6e2c0d',ramdisk_id='',reservation_id='r-9dd4r8h5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1540293599',owner_user_name='tempest-SnapshotDataIntegrityTests-1540293599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T15:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d618fd4a25eb4fbc8ca846939c2745b3',uuid=ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converting VIF {"id": "51589533-181b-4af7-a188-5780843f2a66", "address": "fa:16:3e:4d:78:5c", "network": {"id": "03f4fb79-8b63-44d7-a44f-cba7f7706791", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-425962756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38f471aa860a48c1be9521823c6e2c0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51589533-18", "ovs_interfaceid": "51589533-181b-4af7-a188-5780843f2a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG os_vif [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51589533-18, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00f4f3f6-7a4d-43d6-b562-33393560737a) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:02:59 user nova-compute[74788]: INFO os_vif [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:78:5c,bridge_name='br-int',has_traffic_filtering=True,id=51589533-181b-4af7-a188-5780843f2a66,network=Network(03f4fb79-8b63-44d7-a44f-cba7f7706791),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51589533-18')
Nov 08 16:02:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Deleting instance files /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0_del
Nov 08 16:02:59 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Deletion of /opt/stack/data/nova/instances/ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0_del complete
Nov 08 16:02:59 user nova-compute[74788]: INFO nova.compute.manager [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 08 16:02:59 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:02:59 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-82daacd6-3969-4b0e-a3e8-82998faa6559 req-5db47933-c1f6-42d1-bba9-e3882b291b90 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-deleted-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:03:00 user nova-compute[74788]: INFO nova.compute.manager [req-82daacd6-3969-4b0e-a3e8-82998faa6559 req-5db47933-c1f6-42d1-bba9-e3882b291b90 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Neutron deleted interface 51589533-181b-4af7-a188-5780843f2a66; detaching it from the instance and deleting it from the info cache
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.network.neutron [req-82daacd6-3969-4b0e-a3e8-82998faa6559 req-5db47933-c1f6-42d1-bba9-e3882b291b90 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:03:00 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Took 0.73 seconds to deallocate network for instance.
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.compute.manager [req-82daacd6-3969-4b0e-a3e8-82998faa6559 req-5db47933-c1f6-42d1-bba9-e3882b291b90 service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Detach interface failed, port_id=51589533-181b-4af7-a188-5780843f2a66, reason: Instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0 could not be found. {{(pid=74788) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:03:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:03:00 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Deleted allocations for instance ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0
Nov 08 16:03:00 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-8640f1bd-8539-423c-a762-8783dbd4216f tempest-SnapshotDataIntegrityTests-1540293599 tempest-SnapshotDataIntegrityTests-1540293599-project-member] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:03:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:03:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] Acquiring lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:03:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:03:01 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] Lock "ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:03:01 user nova-compute[74788]: DEBUG nova.compute.manager [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] No waiting events found dispatching network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:03:01 user nova-compute[74788]: WARNING nova.compute.manager [req-519c767a-941a-48bc-9b9c-ae4a72489ddb req-8ba04291-3499-4acd-8ae6-3f497fcf374f service nova] [instance: ad2e0bb7-2d1f-4ca0-8f29-22b4dea8d6b0] Received unexpected event network-vif-plugged-51589533-181b-4af7-a188-5780843f2a66 for instance with vm_state deleted and task_state None.
Nov 08 16:03:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:09 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:09 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 16:03:10 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:03:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:03:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:03:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:03:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:03:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.14965057373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:03:17 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 16:03:18 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 16:03:18 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:03:18 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:03:18 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:03:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:03:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:03:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:03:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:03:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:03:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 16:03:46 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 16:03:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:53 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:56 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:03:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG nova.compute.manager [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing instance network info cache due to event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG nova.network.neutron [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:04:12 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:13 user nova-compute[74788]: DEBUG nova.network.neutron [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated VIF entry in instance network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:04:13 user nova-compute[74788]: DEBUG nova.network.neutron [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:04:13 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-286d0e15-c1de-418e-b1bf-a07ad7147725 req-4b889082-01a1-4d64-8688-908e90a655b9 service nova] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:04:13 user nova-compute[74788]: DEBUG nova.compute.manager [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:04:13 user nova-compute[74788]: INFO nova.compute.manager [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] instance snapshotting
Nov 08 16:04:13 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Beginning live snapshot process
Nov 08 16:04:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json -f qcow2 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a.delta 1073741824 {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a66e0460467b456d73d643debf3dc17b009b5dc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a.delta 1073741824" returned: 0 in 0.047s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 16:04:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 16:04:15 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74788) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 16:04:15 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 16:04:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:15 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:04:15 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a.delta /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:16 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a.delta /opt/stack/data/nova/instances/snapshots/tmph1t381qm/be47a172e7c742cfa6f275d2ae9f832a" returned: 0 in 0.354s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:16 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Snapshot extracted, beginning image upload
Nov 08 16:04:16 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:04:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:04:16 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:04:16 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:04:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:04:17 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.099170684814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:04:17 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:04:18 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:04:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:19 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Snapshot image upload complete
Nov 08 16:04:19 user nova-compute[74788]: INFO nova.compute.manager [None req-6629720f-c3b7-4713-9060-3937d8628a02 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:04:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:21 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:04:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:04:41 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:04:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:04:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:17 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:05:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:05:18 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:05:18 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:19 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:05:19 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.098438262939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:05:19 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:05:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:05:20 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:05:21 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:05:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:22 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:05:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:05:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:05:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:05:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:05:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'flavor' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:05 user nova-compute[74788]: INFO nova.compute.manager [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attaching volume 669a1630-9a00-462f-96d1-7bc0ef8be7ff to /dev/vdb
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.utils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c42a15c-f34e-4d0f-b1b6-8eef1571d401]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1de455d8d6f2\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c3eae4-bd69-485c-bfe0-2ee4fee40b56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b6dda6-f460-442c-bb86-ea895710b2f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c05864-3388-4d6b-b848-a1a05c3fe5b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): nvme version {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] nvme not present on system {{(pid=74788) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:06:05 user nova-compute[74788]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:06:05 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0ac4fb-f21b-43a3-8fff-08f9f0743a5c]: (4, '') {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74788) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.lightos [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] LIGHTOS: no hostnqn found. {{(pid=74788) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG os_brick.utils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1de455d8d6f2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:06:05 user nova-compute[74788]: DEBUG nova.virt.block_device [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating existing volume attachment record: f8090233-ada1-4684-896c-bfa48343c3cd {{(pid=74788) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:06:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:14 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:06:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:20 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:21 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:06:21 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:06:21 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.097721099853516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:06:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:23 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:06:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:06:27 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:06:27 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:06:27 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff1a5d-a05f-4deb-b323-fabed0ece855]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:06:27 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf778a-9c37-401a-8ece-1bb2b7353395]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff] added\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff] added
Nov 08 16:06:27 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81ac670-fcee-4730-8603-4999a54ee829]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5635c-da55-4821-aaff-a09ed7133efe]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRxTuijX {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRxTuijX" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c5887-c749-4d30-b8be-ed5753055ac5]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRxTuijX'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c315e7-640e-46e7-9f78-1ba8d19be8e0]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cb43b9-eb39-468e-8968-aab71e5dcf89]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:06:27 user nova-compute[74788]:  {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:06:27 user nova-compute[74788]:  {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:06:27 user nova-compute[74788]: WARNING os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 16:06:27 user nova-compute[74788]: 
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --login {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb968b1-e591-4884-ba7f-0cb8df917752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260]
Nov 08 16:06:27 user nova-compute[74788]: Login to [iface: default, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260] successful.
Nov 08 16:06:27 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[13556ef0-f740-4de5-a116-4162e72425a8]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d44ff-3658-4c7d-ad14-03ed3c9ff77d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:06:27 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:06:27 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f4dbe-7323-4d15-8285-7f5b1dba88da]: (4, ('- - 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:06:27 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23964613932613862', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964613932613862', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.objects.instance [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'flavor' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:06:28 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:06:28 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:06:28 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:06:28 user nova-compute[74788]:   <serial>669a1630-9a00-462f-96d1-7bc0ef8be7ff</serial>
Nov 08 16:06:28 user nova-compute[74788]: </disk>
Nov 08 16:06:28 user nova-compute[74788]:  {{(pid=74788) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No VIF found with MAC fa:16:3e:6b:b6:39, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:06:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-5b1d2bdd-821e-4ad4-a2e2-e046d00ec819 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.432s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:29 user nova-compute[74788]: INFO nova.compute.manager [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Rescuing
Nov 08 16:06:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG nova.network.neutron [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:06:29 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG nova.compute.manager [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:06:30 user nova-compute[74788]: WARNING nova.compute.manager [req-9cd0165d-c0ad-4625-af56-9c9a60a22167 req-fe269df6-a67f-4a18-84ec-474653624e3e service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state active and task_state rescuing.
Nov 08 16:06:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance destroyed successfully.
Nov 08 16:06:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attempting a stable device rescue
Nov 08 16:06:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74788) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance directory exists: not creating {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 16:06:30 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Creating image(s)
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'trusted_certs' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.part --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG nova.virt.images [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] 6bca0c6e-e11b-4e6b-bdd9-92d59ca8d86c was qcow2, converting to raw {{(pid=74788) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG nova.privsep.utils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74788) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.part /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.converted {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.part /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.converted" returned: 0 in 0.252s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.converted --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.493s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57 --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.compute.manager [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:06:32 user nova-compute[74788]: WARNING nova.compute.manager [req-7175f780-f97e-471a-a18b-f904cad8de03 req-09260b30-55ab-44ae-86d9-9a8ecf07ae55 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state active and task_state rescuing.
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57 --force-share --output=json" returned: 0 in 0.184s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57,backing_fmt=raw /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3d6f9df81b1a84d63df1217051a0689d90ffb57,backing_fmt=raw /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue" returned: 0 in 0.053s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "e3d6f9df81b1a84d63df1217051a0689d90ffb57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'migration_context' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Object Instance<581a3170-8e2b-4e7e-80d5-0dceb137c685> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Created local disks {{(pid=74788) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start _get_guest_xml network_info=[{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "vif_mac": "fa:16:3e:6b:b6:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6bca0c6e-e11b-4e6b-bdd9-92d59ca8d86c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'image_id': '04773e08-e579-43f8-a159-498093451850'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '581a3170-8e2b-4e7e-80d5-0dceb137c685', 'attached_at': '', 'detached_at': '', 'volume_id': '669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'serial': '669a1630-9a00-462f-96d1-7bc0ef8be7ff'}, 'attachment_id': 'f8090233-ada1-4684-896c-bfa48343c3cd', 'delete_on_termination': False, 'volume_type': None} {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'resources' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Object Instance<581a3170-8e2b-4e7e-80d5-0dceb137c685> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'numa_topology' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Object Instance<581a3170-8e2b-4e7e-80d5-0dceb137c685> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:06:32 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:06:32 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU controller missing on host. {{(pid=74788) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.host [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU controller found on host. {{(pid=74788) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74788) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T15:07:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T15:07:53Z,direct_url=<?>,disk_format='qcow2',id=04773e08-e579-43f8-a159-498093451850,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='254acd68c75a4566a1bb22e22571fa34',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T15:07:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Flavor limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Image limits 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Flavor pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Image pref 0:0:0 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Got 1 possible topologies {{(pid=74788) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.hardware [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74788) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'vcpu_model' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Object Instance<581a3170-8e2b-4e7e-80d5-0dceb137c685> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Calling os-brick to attach iSCSI Volume {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:06:32 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:06:32 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:06:32 user nova-compute[74788]: INFO os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d3409f-2726-4591-a746-d90625c17f85]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JRxTuijX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 16:06:32 user nova-compute[74788]: node.name = iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff
Nov 08 16:06:32 user nova-compute[74788]: node.tpgt = -1
Nov 08 16:06:32 user nova-compute[74788]: node.startup = automatic
Nov 08 16:06:32 user nova-compute[74788]: node.leading_login = No
Nov 08 16:06:32 user nova-compute[74788]: iface.iscsi_ifacename = default
Nov 08 16:06:32 user nova-compute[74788]: iface.net_ifacename = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.ipaddress = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.prefix_len = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.hwaddress = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.transport_name = tcp
Nov 08 16:06:32 user nova-compute[74788]: iface.initiatorname = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.vlan_id = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.vlan_priority = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.vlan_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.iface_num = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.mtu = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.port = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.bootproto = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.subnet_mask = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.gateway = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_alt_client_id = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_dns = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_learn_iqn = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_vendor_id_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_vendor_id = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.dhcp_slp_da = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.fragmentation = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.gratuitous_arp = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.incoming_forwarding = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.tos_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.tos = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.ttl = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.delayed_ack = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.tcp_nagle = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.tcp_wsf_state = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.tcp_wsf = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.tcp_timer_scale = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.tcp_timestamp = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.redirect = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.def_task_mgmt_timeout = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.header_digest = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.data_digest = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.immediate_data = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.initial_r2t = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.data_seq_inorder = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.data_pdu_inorder = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.erl = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.max_receive_data_len = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.first_burst_len = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.max_outstanding_r2t = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.max_burst_len = 0
Nov 08 16:06:32 user nova-compute[74788]: iface.chap_auth = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.bidi_chap = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.strict_login_compliance = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.discovery_auth = <empty>
Nov 08 16:06:32 user nova-compute[74788]: iface.discovery_logout = <empty>
Nov 08 16:06:32 user nova-compute[74788]: node.discovery_address = <empty>
Nov 08 16:06:32 user nova-compute[74788]: node.discovery_port = 0
Nov 08 16:06:32 user nova-compute[74788]: node.discovery_type = static
Nov 08 16:06:32 user nova-compute[74788]: node.session.initial_cmdsn = 0
Nov 08 16:06:32 user nova-compute[74788]: node.session.initial_login_retry_max = 8
Nov 08 16:06:32 user nova-compute[74788]: node.session.xmit_thread_priority = -20
Nov 08 16:06:32 user nova-compute[74788]: node.session.cmds_max = 128
Nov 08 16:06:32 user nova-compute[74788]: node.session.queue_depth = 32
Nov 08 16:06:32 user nova-compute[74788]: node.session.nr_sessions = 1
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.authmethod = CHAP
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.username = JRxTuijX
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.password = ***
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.username_in = <empty>
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.password_in = <empty>
Nov 08 16:06:32 user nova-compute[74788]: node.session.auth.chap_algs = MD5
Nov 08 16:06:32 user nova-compute[74788]: node.session.timeo.replacement_timeout = 120
Nov 08 16:06:32 user nova-compute[74788]: node.session.err_timeo.abort_timeout = 15
Nov 08 16:06:32 user nova-compute[74788]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 16:06:32 user nova-compute[74788]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 16:06:32 user nova-compute[74788]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.FastAbort = Yes
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.InitialR2T = No
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.ImmediateData = Yes
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.MaxConnections = 1
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 16:06:32 user nova-compute[74788]: node.session.iscsi.ERL = 0
Nov 08 16:06:32 user nova-compute[74788]: node.session.scan = manual
Nov 08 16:06:32 user nova-compute[74788]: node.session.reopen_max = 0
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].address = 172.16.0.220
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].port = 3260
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].startup = manual
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].tcp.window_size = 524288
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].tcp.type_of_service = 0
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].timeo.logout_timeout = 15
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].timeo.login_timeout = 15
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].timeo.auth_timeout = 45
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.DataDigest = None
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.IFMarker = No
Nov 08 16:06:32 user nova-compute[74788]: node.conn[0].iscsi.OFMarker = No
Nov 08 16:06:32 user nova-compute[74788]: # END RECORD
Nov 08 16:06:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027a2cf-4249-40a5-920f-8674e3ae2710]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa116d3-4b2a-49a5-b631-08d1da987f09]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRxTuijX {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRxTuijX" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a15ff5-c68a-4752-9e29-cb4d6c8974c2]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRxTuijX'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febdb73-1649-4228-aa62-79a60888dc9d]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758b0f9-2545-4f0a-b843-766b92fe3ee5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:06:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:06:32 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Connected to 172.16.0.220:3260 {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] HCTL ('33', '0', '0', 0) found on session 59 with lun 0 {{(pid=74788) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74788) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70b385-046a-4ca0-9306-21d5b04fd3c5]: (4, ('0 0 0', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Searching for a device in session 59 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74788) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74788) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23964613932613862', 'path': '/dev/sdb'} {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964613932613862', 'path': '/dev/sdb'} {{(pid=74788) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-989647765',display_name='tempest-ServerStableDeviceRescueTest-server-989647765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-989647765',id=52,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPJac6zd2bp6B5NSkp5cyi/JJoqzzJySFvGC67hME367sz3oWpc0RdiQUUWPfyVdhJewOouOT/VWtgJeEz9AJPOUOkDQlSemJG6qWji62fSRqba3YTrn5oe/xpIG9LdOQ==',key_name='tempest-keypair-1968090045',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:02:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a92f409c22c42e1a5d2c9936a3283fc',ramdisk_id='',reservation_id='r-w6r3muki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2108142585',owner_user_name='tempest-ServerStableDeviceRescueTest-2108142585-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f03829e3fc6437e9de435d9e5e0eb1c',uuid=581a3170-8e2b-4e7e-80d5-0dceb137c685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "vif_mac": "fa:16:3e:6b:b6:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74788) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converting VIF {"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "vif_mac": "fa:16:3e:6b:b6:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.instance [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'pci_devices' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.objects.base [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Object Instance<581a3170-8e2b-4e7e-80d5-0dceb137c685> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74788) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:06:32 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:06:32 user nova-compute[74788]:   <uuid>581a3170-8e2b-4e7e-80d5-0dceb137c685</uuid>
Nov 08 16:06:32 user nova-compute[74788]:   <name>instance-00000034</name>
Nov 08 16:06:32 user nova-compute[74788]:   <memory>524288</memory>
Nov 08 16:06:32 user nova-compute[74788]:   <vcpu>1</vcpu>
Nov 08 16:06:32 user nova-compute[74788]:   <metadata>
Nov 08 16:06:32 user nova-compute[74788]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:06:32 user nova-compute[74788]:       <nova:package version="0.0.0"/>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-989647765</nova:name>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:creationTime>2023-11-08 16:06:32</nova:creationTime>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:flavor name="m1.tiny">
Nov 08 16:06:32 user nova-compute[74788]:         <nova:memory>512</nova:memory>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:disk>1</nova:disk>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:swap>0</nova:swap>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:06:32 user nova-compute[74788]:       </nova:flavor>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:owner>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:user uuid="9f03829e3fc6437e9de435d9e5e0eb1c">tempest-ServerStableDeviceRescueTest-2108142585-project-member</nova:user>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:project uuid="9a92f409c22c42e1a5d2c9936a3283fc">tempest-ServerStableDeviceRescueTest-2108142585</nova:project>
Nov 08 16:06:32 user nova-compute[74788]:       </nova:owner>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:root type="image" uuid="04773e08-e579-43f8-a159-498093451850"/>
Nov 08 16:06:32 user nova-compute[74788]:       <nova:ports>
Nov 08 16:06:32 user nova-compute[74788]:         <nova:port uuid="29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4">
Nov 08 16:06:32 user nova-compute[74788]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 16:06:32 user nova-compute[74788]:         </nova:port>
Nov 08 16:06:32 user nova-compute[74788]:       </nova:ports>
Nov 08 16:06:32 user nova-compute[74788]:     </nova:instance>
Nov 08 16:06:32 user nova-compute[74788]:   </metadata>
Nov 08 16:06:32 user nova-compute[74788]:   <sysinfo type="smbios">
Nov 08 16:06:32 user nova-compute[74788]:     <system>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="version">0.0.0</entry>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="serial">581a3170-8e2b-4e7e-80d5-0dceb137c685</entry>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="uuid">581a3170-8e2b-4e7e-80d5-0dceb137c685</entry>
Nov 08 16:06:32 user nova-compute[74788]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:06:32 user nova-compute[74788]:     </system>
Nov 08 16:06:32 user nova-compute[74788]:   </sysinfo>
Nov 08 16:06:32 user nova-compute[74788]:   <os>
Nov 08 16:06:32 user nova-compute[74788]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:06:32 user nova-compute[74788]:     <smbios mode="sysinfo"/>
Nov 08 16:06:32 user nova-compute[74788]:   </os>
Nov 08 16:06:32 user nova-compute[74788]:   <features>
Nov 08 16:06:32 user nova-compute[74788]:     <acpi/>
Nov 08 16:06:32 user nova-compute[74788]:     <apic/>
Nov 08 16:06:32 user nova-compute[74788]:     <vmcoreinfo/>
Nov 08 16:06:32 user nova-compute[74788]:   </features>
Nov 08 16:06:32 user nova-compute[74788]:   <clock offset="utc">
Nov 08 16:06:32 user nova-compute[74788]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:06:32 user nova-compute[74788]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:06:32 user nova-compute[74788]:     <timer name="hpet" present="no"/>
Nov 08 16:06:32 user nova-compute[74788]:   </clock>
Nov 08 16:06:32 user nova-compute[74788]:   <cpu mode="custom" match="exact">
Nov 08 16:06:32 user nova-compute[74788]:     <model>Nehalem</model>
Nov 08 16:06:32 user nova-compute[74788]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:06:32 user nova-compute[74788]:   </cpu>
Nov 08 16:06:32 user nova-compute[74788]:   <devices>
Nov 08 16:06:32 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 16:06:32 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:06:32 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk"/>
Nov 08 16:06:32 user nova-compute[74788]:       <target dev="vda" bus="virtio"/>
Nov 08 16:06:32 user nova-compute[74788]:     </disk>
Nov 08 16:06:32 user nova-compute[74788]:     <disk type="block" device="disk">
Nov 08 16:06:32 user nova-compute[74788]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:06:32 user nova-compute[74788]:       <source dev="/dev/sdb"/>
Nov 08 16:06:32 user nova-compute[74788]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:06:32 user nova-compute[74788]:       <serial>669a1630-9a00-462f-96d1-7bc0ef8be7ff</serial>
Nov 08 16:06:32 user nova-compute[74788]:     </disk>
Nov 08 16:06:32 user nova-compute[74788]:     <disk type="file" device="disk">
Nov 08 16:06:32 user nova-compute[74788]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:06:32 user nova-compute[74788]:       <source file="/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue"/>
Nov 08 16:06:32 user nova-compute[74788]:       <target dev="vdc" bus="virtio"/>
Nov 08 16:06:32 user nova-compute[74788]:       <boot order="1"/>
Nov 08 16:06:32 user nova-compute[74788]:     </disk>
Nov 08 16:06:32 user nova-compute[74788]:     <interface type="ethernet">
Nov 08 16:06:32 user nova-compute[74788]:       <mac address="fa:16:3e:6b:b6:39"/>
Nov 08 16:06:32 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 16:06:32 user nova-compute[74788]:       <mtu size="1442"/>
Nov 08 16:06:32 user nova-compute[74788]:       <target dev="tap29a74c9c-d4"/>
Nov 08 16:06:32 user nova-compute[74788]:     </interface>
Nov 08 16:06:32 user nova-compute[74788]:     <serial type="pty">
Nov 08 16:06:32 user nova-compute[74788]:       <log file="/opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/console.log" append="off"/>
Nov 08 16:06:32 user nova-compute[74788]:     </serial>
Nov 08 16:06:32 user nova-compute[74788]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:06:32 user nova-compute[74788]:     <video>
Nov 08 16:06:32 user nova-compute[74788]:       <model type="virtio"/>
Nov 08 16:06:32 user nova-compute[74788]:     </video>
Nov 08 16:06:32 user nova-compute[74788]:     <rng model="virtio">
Nov 08 16:06:32 user nova-compute[74788]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:06:32 user nova-compute[74788]:     </rng>
Nov 08 16:06:32 user nova-compute[74788]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:06:32 user nova-compute[74788]:     <memballoon model="virtio">
Nov 08 16:06:32 user nova-compute[74788]:       <stats period="10"/>
Nov 08 16:06:32 user nova-compute[74788]:     </memballoon>
Nov 08 16:06:32 user nova-compute[74788]:   </devices>
Nov 08 16:06:32 user nova-compute[74788]: </domain>
Nov 08 16:06:32 user nova-compute[74788]:  {{(pid=74788) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:06:32 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance destroyed successfully.
Nov 08 16:06:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:06:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:06:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74788) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:06:33 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] No VIF found with MAC fa:16:3e:6b:b6:39, not building metadata {{(pid=74788) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG nova.compute.manager [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:06:34 user nova-compute[74788]: WARNING nova.compute.manager [req-668f4108-9215-4255-9617-05d9dba29dfe req-85a10296-7de2-4e62-8479-a3bbb9ca5e38 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state active and task_state rescuing.
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:06:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:06:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:06:36 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:06:36 user nova-compute[74788]: DEBUG nova.compute.manager [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:06:36 user nova-compute[74788]: WARNING nova.compute.manager [req-fb46c57f-b86f-423d-9d2b-55093d51a607 req-2f04f150-c577-4a94-876c-1cca64e6bd73 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state active and task_state rescuing.
Nov 08 16:06:36 user nova-compute[74788]: DEBUG nova.compute.manager [None req-a49eaa7b-47f8-424f-bf9e-20fce289e7fc tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:06:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:45 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:06:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:06:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:06:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:07:15 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:07:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:07:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:07:20 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:07:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:07:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:07:22 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.000865936279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:07:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:07:24 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:07:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:31 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:34 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:07:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:07:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:07:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:07:56 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:07:59 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:08:04 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:09 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:14 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:08:17 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:19 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:20 user nova-compute[74788]: INFO nova.compute.manager [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Unrescuing
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Building network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG nova.network.neutron [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:08:20 user nova-compute[74788]: DEBUG nova.objects.instance [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'flavor' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:08:21 user nova-compute[74788]: WARNING nova.compute.manager [req-a7e0d0d9-ef08-4638-ac77-1c212d718db8 req-2f0a4df1-58b4-4f53-b270-91d7462c83e5 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.compute.manager [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing instance network info cache due to event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.network.neutron [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance destroyed successfully.
Nov 08 16:08:21 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74788) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:08:21 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:08:22 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:08:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated VIF entry in instance network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:08:22 user nova-compute[74788]: DEBUG nova.network.neutron [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:08:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-d10b7cf9-1236-434b-9069-0044811f7ee5 req-7f2d7634-3192-4283-a512-f6fb4ffba181 service nova] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:08:25 user nova-compute[74788]: WARNING nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:08:25 user nova-compute[74788]: WARNING nova.compute.manager [req-736a8914-b265-4433-8ccb-96a791c234c8 req-0ed704b6-876b-445f-96e3-0b6fd50a0506 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing instance network info cache due to event network-changed-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.network.neutron [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Refreshing network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-f0f09519-ad3c-481b-a35f-e289779f8615 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Checking state {{(pid=74788) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:08:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:08:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=25.000228881835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:08:25 user nova-compute[74788]: WARNING nova.compute.manager [req-b0242c18-cf78-46ba-9ed1-167ffef6913a req-9134b9aa-1bdd-4508-9d19-45c56744f948 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing inventories for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating ProviderTree inventory for provider e3449262-5ea3-41b5-a9f5-efda3df45537 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Updating inventory in ProviderTree for provider e3449262-5ea3-41b5-a9f5-efda3df45537 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing aggregate associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, aggregates: None {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Refreshing trait associations for resource provider e3449262-5ea3-41b5-a9f5-efda3df45537, traits: COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=74788) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:25 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74788) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 16:08:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated VIF entry in instance network info cache for port 29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4. {{(pid=74788) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:08:26 user nova-compute[74788]: DEBUG nova.network.neutron [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:08:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-87b3c434-db07-48fd-b58f-ee2196c9c944 req-116c059f-1686-4388-9f07-a573fd45cda1 service nova] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:08:29 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:08:29 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:08:30 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Triggering sync for uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:39 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:08:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:46 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:49 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:08:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Cleaning up deleted instances {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 16:08:49 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] There are 0 instances to clean {{(pid=74788) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 16:08:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:08:53 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:08:53 user nova-compute[74788]: INFO nova.compute.manager [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Detaching volume 669a1630-9a00-462f-96d1-7bc0ef8be7ff
Nov 08 16:08:53 user nova-compute[74788]: INFO nova.virt.block_device [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Attempting to driver detach volume 669a1630-9a00-462f-96d1-7bc0ef8be7ff from mountpoint /dev/vdb
Nov 08 16:08:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Attempting to detach device vdb from instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 from the persistent domain config. {{(pid=74788) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:08:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:08:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:08:53 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:08:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:08:53 user nova-compute[74788]:   <serial>669a1630-9a00-462f-96d1-7bc0ef8be7ff</serial>
Nov 08 16:08:53 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:08:53 user nova-compute[74788]: </disk>
Nov 08 16:08:53 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:08:53 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Successfully detached device vdb from instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 from the persistent domain config.
Nov 08 16:08:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 from the live domain config. {{(pid=74788) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:08:53 user nova-compute[74788]: DEBUG nova.virt.libvirt.guest [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:08:53 user nova-compute[74788]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:08:53 user nova-compute[74788]:   <source dev="/dev/sdb"/>
Nov 08 16:08:53 user nova-compute[74788]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:08:53 user nova-compute[74788]:   <serial>669a1630-9a00-462f-96d1-7bc0ef8be7ff</serial>
Nov 08 16:08:53 user nova-compute[74788]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:08:53 user nova-compute[74788]: </disk>
Nov 08 16:08:53 user nova-compute[74788]:  {{(pid=74788) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:08:54 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:08:54 user nova-compute[74788]: DEBUG nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:08:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:14 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 is timed out.
Nov 08 16:09:14 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Successfully detached device vdb from instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 from the live domain config.
Nov 08 16:09:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] calling os-brick to detach iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f777c4c8370>, {'target_iqn': 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRxTuijX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:09:14 user nova-compute[74788]: WARNING os_brick.initiator.connectors.base [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[794148e6-1f2b-400c-8c7d-59f7d5ef67fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:09:14 user nova-compute[74788]: No targets found.
Nov 08 16:09:14 user nova-compute[74788]: iSNS:
Nov 08 16:09:14 user nova-compute[74788]: No targets found.
Nov 08 16:09:14 user nova-compute[74788]: STATIC:
Nov 08 16:09:14 user nova-compute[74788]: Target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff
Nov 08 16:09:14 user nova-compute[74788]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:09:14 user nova-compute[74788]:                 Iface Name: default
Nov 08 16:09:14 user nova-compute[74788]: FIRMWARE:
Nov 08 16:09:14 user nova-compute[74788]: No targets found.
Nov 08 16:09:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:09:14 user nova-compute[74788]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:09:14 user nova-compute[74788]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74788) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff', 0)] {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c54baa-0f95-4347-ba22-2a530f440144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535e334-143e-468f-a3fd-cd38de1c95bd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:09:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff (non-flash)
Nov 08 16:09:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f777c2fc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff'): ({'sdb'}, set())}) {{(pid=74788) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Removing single pathed devices sdb {{(pid=74788) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[e878c7f6-b3a4-4dde-bcf4-796fe584dc9b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abc6848-726a-4d11-ae0f-a909707c32a4]: (4, ('ok\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Flushing IO for device /dev/sdb {{(pid=74788) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0c65e8-566c-4f8b-a658-43481db1296f]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74788) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2d9e6-0cdb-4026-9e94-e17a2e41492f]: (4, ('1', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.linuxscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] SCSI volumes sdb have been removed. {{(pid=74788) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff')] {{(pid=74788) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[7453d0f9-9e52-489d-a0b3-cfedecb927ca]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --logout {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f0d9a-4d99-4b46-a394-662ad85e281a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260]
Nov 08 16:09:14 user nova-compute[74788]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff, portal: 172.16.0.220,3260] successful.
Nov 08 16:09:14 user nova-compute[74788]:  stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op delete {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:669a1630-9a00-462f-96d1-7bc0ef8be7ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85485) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38ac44-2cf3-4f3a-ae7b-0e369dc4c323]: (4, ('', '')) {{(pid=85485) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74788) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.base [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG os_brick.initiator.connectors.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] <== disconnect_volume: return (311ms) None {{(pid=74788) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:09:14 user nova-compute[74788]: DEBUG nova.virt.libvirt.volume.iscsi [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Disconnected iSCSI Volume {{(pid=74788) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:09:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:15 user nova-compute[74788]: DEBUG nova.objects.instance [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'flavor' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:09:15 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-684d9b79-2130-406b-bdcc-2239fb1ddf2c tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.965s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:18 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.processutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74788) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:09:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:09:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.999897003173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Instance 581a3170-8e2b-4e7e-80d5-0dceb137c685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74788) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:09:23 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:09:24 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:09:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquired lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Forcefully refreshing network info cache for instance {{(pid=74788) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.objects.instance [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lazy-loading 'info_cache' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.network.neutron [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [{"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Releasing lock "refresh_cache-581a3170-8e2b-4e7e-80d5-0dceb137c685" {{(pid=74788) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updated the network info_cache for instance {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:26 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:09:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:32 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:09:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:44 user nova-compute[74788]: INFO nova.compute.manager [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Terminating instance
Nov 08 16:09:44 user nova-compute[74788]: DEBUG nova.compute.manager [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Start destroying the instance on the hypervisor. {{(pid=74788) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG nova.compute.manager [req-cd79ec60-f18a-4dc8-a20f-de52649f5b1b req-17456c58-7d94-4a6b-b533-0d64451a72b6 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-unplugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with task_state deleting. {{(pid=74788) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:09:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Instance destroyed successfully.
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.objects.instance [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lazy-loading 'resources' on Instance uuid 581a3170-8e2b-4e7e-80d5-0dceb137c685 {{(pid=74788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.virt.libvirt.vif [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-989647765',display_name='tempest-ServerStableDeviceRescueTest-server-989647765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-989647765',id=52,image_ref='04773e08-e579-43f8-a159-498093451850',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPJac6zd2bp6B5NSkp5cyi/JJoqzzJySFvGC67hME367sz3oWpc0RdiQUUWPfyVdhJewOouOT/VWtgJeEz9AJPOUOkDQlSemJG6qWji62fSRqba3YTrn5oe/xpIG9LdOQ==',key_name='tempest-keypair-1968090045',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a92f409c22c42e1a5d2c9936a3283fc',ramdisk_id='',reservation_id='r-w6r3muki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='04773e08-e579-43f8-a159-498093451850',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2108142585',owner_user_name='tempest-ServerStableDeviceRescueTest-2108142585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f03829e3fc6437e9de435d9e5e0eb1c',uuid=581a3170-8e2b-4e7e-80d5-0dceb137c685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converting VIF {"id": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "address": "fa:16:3e:6b:b6:39", "network": {"id": "f09fa3aa-e311-4d54-9d7b-a31bbd0ec386", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-255418006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a92f409c22c42e1a5d2c9936a3283fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a74c9c-d4", "ovs_interfaceid": "29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.network.os_vif_util [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG os_vif [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4') {{(pid=74788) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29a74c9c-d4, bridge=br-int, if_exists=True) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c502e7d-66f3-4555-b7ea-6e431f6e13e4) {{(pid=74788) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:09:45 user nova-compute[74788]: INFO os_vif [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b6:39,bridge_name='br-int',has_traffic_filtering=True,id=29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4,network=Network(f09fa3aa-e311-4d54-9d7b-a31bbd0ec386),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a74c9c-d4')
Nov 08 16:09:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Deleting instance files /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685_del
Nov 08 16:09:45 user nova-compute[74788]: INFO nova.virt.libvirt.driver [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Deletion of /opt/stack/data/nova/instances/581a3170-8e2b-4e7e-80d5-0dceb137c685_del complete
Nov 08 16:09:45 user nova-compute[74788]: INFO nova.compute.manager [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 16:09:45 user nova-compute[74788]: DEBUG oslo.service.loopingcall [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74788) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.compute.manager [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Deallocating network for instance {{(pid=74788) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] deallocate_for_instance() {{(pid=74788) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:09:45 user nova-compute[74788]: DEBUG nova.network.neutron [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Updating instance_info_cache with network_info: [] {{(pid=74788) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:09:46 user nova-compute[74788]: INFO nova.compute.manager [-] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Took 0.85 seconds to deallocate network for instance.
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-4f1bc50e-5f5a-4bdc-9ee6-fd0b3b4b069d req-db63b418-3168-41cf-b139-edea8075e22e service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-deleted-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:46 user nova-compute[74788]: INFO nova.scheduler.client.report [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Deleted allocations for instance 581a3170-8e2b-4e7e-80d5-0dceb137c685
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-aec40669-d674-4f5f-9c59-1a1c6e895c67 tempest-ServerStableDeviceRescueTest-2108142585 tempest-ServerStableDeviceRescueTest-2108142585-project-member] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] Acquiring lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] Lock "581a3170-8e2b-4e7e-80d5-0dceb137c685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:09:46 user nova-compute[74788]: DEBUG nova.compute.manager [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] No waiting events found dispatching network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 {{(pid=74788) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:09:46 user nova-compute[74788]: WARNING nova.compute.manager [req-6a944930-96b3-45ee-b5e5-5dd0c7ba24e9 req-9f5fb4ba-5d07-40e3-9643-42b0eb136425 service nova] [instance: 581a3170-8e2b-4e7e-80d5-0dceb137c685] Received unexpected event network-vif-plugged-29a74c9c-d4f7-4cf7-bf6c-ab5fd96b6dd4 for instance with vm_state deleted and task_state None.
Nov 08 16:09:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:09:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:10:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:20 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:10:22 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:10:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:10:23 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.12451934814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:10:23 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:10:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:27 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:10:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:33 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:34 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:10:46 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:48 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:49 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:10:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:10:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:11:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:11:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:11:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:23 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:11:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:11:24 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:11:24 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:11:25 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9160MB free_disk=25.10696029663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:11:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:11:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:11:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:35 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:36 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:11:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:11:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:11:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:10 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:12:15 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:20 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:22 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:24 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74788) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74788) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:12:25 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Auditing locally available compute resources for user (node: user) {{(pid=74788) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:12:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:12:26 user nova-compute[74788]: WARNING nova.virt.libvirt.driver [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Hypervisor/Node resource view: name=user free_ram=9160MB free_disk=25.1058349609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74788) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74788) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.compute.provider_tree [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed in ProviderTree for provider: e3449262-5ea3-41b5-a9f5-efda3df45537 {{(pid=74788) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.scheduler.client.report [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Inventory has not changed for provider e3449262-5ea3-41b5-a9f5-efda3df45537 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74788) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG nova.compute.resource_tracker [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Compute_service record updated for user:user {{(pid=74788) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:12:26 user nova-compute[74788]: DEBUG oslo_concurrency.lockutils [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=74788) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74788) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Starting heal instance info cache {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Rebuilding the list of instances to heal {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:12:28 user nova-compute[74788]: DEBUG nova.compute.manager [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Didn't find any instances for network info cache update. {{(pid=74788) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:12:29 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:30 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:12:35 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:37 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:38 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:39 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:40 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:44 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:45 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:50 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:12:51 user nova-compute[74788]: DEBUG oslo_service.periodic_task [None req-ce2fce3a-d123-4ad3-8c69-f6380386e963 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74788) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:12:55 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:13:00 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:13:05 user nova-compute[74788]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74788) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}